Jul 07 17:15:00 devstack cinder-volume[75996]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:15:00 devstack cinder-volume[75996]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:15:00 devstack cinder-volume[75996]: we strongly recommend against using it for new projects. Jul 07 17:15:00 devstack cinder-volume[75996]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:15:00 devstack cinder-volume[75996]: framework. For more detail see Jul 07 17:15:00 devstack cinder-volume[75996]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:15:00 devstack cinder-volume[75996]: import eventlet # noqa Jul 07 17:15:03 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:03 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:03 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:04 devstack cinder-volume[75996]: INFO dbcounter [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Registered counter for database cinder Jul 07 17:15:04 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:04 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writer thread running {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:15:04 devstack cinder-volume[75996]: INFO cinder.rpc [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:15:04 devstack cinder-volume[75996]: INFO cinder.rpc [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:15:04 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:04 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Determined volume DB was empty at startup. Jul 07 17:15:04 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75996) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:15:04 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:15:04 devstack cinder-volume[75996]: WARNING stevedore.named [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:15:04 devstack cinder-volume[75996]: WARNING castellan.key_manager [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:04 devstack cinder-volume[75996]: WARNING cinder.keymgr.conf_key_mgr [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:04 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75996) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 17:15:04 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] CMD "cinder-rtstool verify" returned: 0 in 0.413s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:05 devstack cinder-volume[75996]: INFO cinder.rpc [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 17:15:05 devstack cinder-volume[75996]: INFO cinder.rpc [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 17:15:05 devstack cinder-volume[75996]: WARNING stevedore.named [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:15:05 devstack cinder-volume[75996]: WARNING castellan.key_manager [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:05 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:05 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Starting 1 workers Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Started child 76165 {{(pid=75996) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Full set of CONF: {{(pid=75996) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] ******************************************************************************** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Configuration options gathered from: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] ================================================================================ {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] allow_availability_zone_fallback = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] allow_compression_on_image_upload = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] allowed_direct_url_schemes = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] api_rate_limit = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] auth_strategy = keystone {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] az_cache_duration = 3600 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_host = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_stats_polling_interval = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[76165]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backup_api_class = cinder.backup.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backup_name_template = backup-%s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backup_use_same_host = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backup_use_temp_snapshot = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] chap_password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] chap_username = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_internal_tenant_project_id = 40eb47350d1b49819d2d2ebbf3b8ad33 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_internal_tenant_user_id = 9c6bd7224908411e942e61dc6a3ce854 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cloned_volume_same_az = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cluster = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] compression_format = gzip {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] compute_api_class = cinder.compute.nova.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] config_dir = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] config_source = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] control_exchange = openstack {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] debug = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] default_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] default_group_type = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] default_volume_type = lvmdriver-1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] disk_geometry = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] driver_client_cert = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] driver_client_cert_key = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] driver_data_namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] driver_ssl_cert_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] driver_ssl_cert_verify = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] driver_use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] enable_force_upload = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] enable_new_services = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] enable_unsupported_driver = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] enforce_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] filter_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_api_insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_api_ssl_compression = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_ca_certificates_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_catalog_info = image:glance:publicURL {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_num_retries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance_request_timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] goodness_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] graceful_shutdown_timeout = 5 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] group_api_class = cinder.group.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] host = devstack {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_compress_on_upload = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_conversion_address_space_limit = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_conversion_cpu_limit = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_conversion_disable = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_upload_use_cinder_backend = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_upload_use_internal_tenant = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_volume_cache_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_volume_cache_max_count = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] image_volume_cache_max_size_gb = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] init_host_max_objects_retrieval = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] instance_format = [instance: %(uuid)s] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] iscsi_target_flags = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] iscsi_write_cache = on {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] iser_helper = tgtadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] iser_ip_address = 192.168.122.136 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] iser_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_color = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_config_append = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_dir = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_options = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_rotate_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_rotate_interval_type = days {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] log_rotation_type = none {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] max_age = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] max_logfile_count = 30 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] max_logfile_size_mb = 200 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] max_over_subscription_ratio = 20.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] message_reap_interval = 86400 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] message_ttl = 2592000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] migration_create_volume_timeout_secs = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] monkey_patch = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] monkey_patch_modules = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] my_ip = 192.168.122.136 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] no_snapshot_gb_quota = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] num_iser_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] num_shell_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] num_volume_device_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] nvmeof_conn_info_version = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] nvmet_ns_id = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] nvmet_port_id = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_max_limit = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_volume_ext_list = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_volume_listen_port = 8776 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_volume_use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] osapi_volume_workers = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] per_volume_size_limit = -1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] periodic_fuzzy_delay = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] periodic_interval = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] public_endpoint = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] publish_errors = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_backup_gigabytes = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_backups = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_gigabytes = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_groups = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_snapshots = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] quota_volumes = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] rate_limit_burst = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] rate_limit_except_level = CRITICAL {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] rate_limit_interval = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] reinit_driver_count = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] replication_device = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] report_discard_supported = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] report_interval = 120 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] reservation_clean_interval = 86400 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] reservation_expire = 86400 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] reserved_image_namespaces = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] reserved_percentage = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] rpc_response_timeout = 120 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] run_external_periodic_tasks = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[76165]: INFO cinder.volume.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] scst_target_driver = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] scst_target_iqn_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_down_time = 720 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] shell_completion = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] snapshot_name_template = snapshot-%s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] snapshot_same_host = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] state_path = /opt/stack/data/cinder {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] storage_availability_zone = nova {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] storage_protocol = iSCSI {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] syslog_log_facility = LOG_USER {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] target_helper = lioadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] target_ip_address = 192.168.122.136 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] target_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] target_protocol = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] target_secondary_ip_addresses = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] trace_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] transport_url = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] until_refresh = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_chap_auth = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_default_quota_class = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_journal = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_json = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_stderr = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] use_syslog = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] verify_glance_signatures = enabled {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_api_class = cinder.volume.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_backend_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_clear = zero {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_clear_ionice = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_clear_size = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_copy_bps_limit = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_dd_blocksize = 1M {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_name_template = volume-%s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_service_inithost_offload = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volume_usage_audit_period = month {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] zoning_mode = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_concurrency.disable_process_locking = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.auth_type = password {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.auth_version = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.cache = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.include_service_catalog = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.interface = public {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_password = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcache_username = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.region_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.service_type = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.backend = dogpile.cache.null {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.backend_argument = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.backend_expiration_time = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.config_prefix = cache.oslo {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.debug_cache_backend = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.enable_retry_client = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.enable_socket_keepalive = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.expiration_time = 600 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.hashclient_retry_attempts = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_dead_retry = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_pool_maxsize = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_sasl_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.proxies = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.redis_db = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.redis_server = localhost:6379 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.retry_attempts = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.retry_delay = 0.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.socket_keepalive_count = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.socket_keepalive_idle = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.socket_keepalive_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.socket_timeout = 1.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.tls_allowed_ciphers = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.tls_cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.tls_certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.tls_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.tls_keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cache.username = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] coordination.backend_url = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.asyncio_connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.asyncio_slave_connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.backend = sqlalchemy {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.connection_debug = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.connection_parameters = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.connection_recycle_time = 3600 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.connection_trace = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.db_inc_retry_interval = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.db_max_retries = 20 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.db_max_retry_interval = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.db_retry_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.max_overflow = 50 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.max_pool_size = 5 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.max_retries = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.mysql_wsrep_sync_wait = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.pool_timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.retry_interval = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.slave_connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.sqlite_synchronous = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.synchronous_reader = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] database.use_db_reconnect = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.connection_string = messaging:// {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.es_doc_type = notification {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.es_scroll_size = 10000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.es_scroll_time = 2m {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.filter_error_trace = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.hmac_keys = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.sentinel_service_name = mymaster {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.socket_timeout = 0.1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.trace_requests = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler.trace_sqlalchemy = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler_jaeger.process_tags = {} {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler_jaeger.service_name_prefix = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] profiler_otlp.service_name_prefix = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.enforce_new_defaults = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.enforce_scope = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.policy_default_rule = default {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.policy_file = policy.yaml {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:05 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.group = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.helper_command = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] privsep_osbrick.user = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.group = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.helper_command = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] cinder_sys_admin.user = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.auth_type = password {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.send_service_user_token = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] service_user.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.auth_type = password {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.region_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] glance.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.backend_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.chap_password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.chap_username = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.disk_geometry = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.driver_client_cert = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.driver_client_cert_key = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.driver_data_namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.driver_use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.extra_capabilities = {} {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.filter_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.goodness_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.iscsi_target_flags = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.iscsi_write_cache = on {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.iser_helper = tgtadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.iser_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.lvm_share_target = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.lvm_type = auto {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.num_shell_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.replication_device = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.report_discard_supported = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.reserved_percentage = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack sudo[76169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.target_helper = tgtadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.target_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.target_protocol = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack sudo[76169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.trace_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.unique_fqdn_network = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.use_chap_auth = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_backend_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_clear = zero {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_clear_ionice = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_clear_size = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_reports.file_event_handler = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_reports.log_dir = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.backend_host = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.chap_password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.chap_username = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.disk_geometry = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.driver_client_cert = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.extra_capabilities = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.filter_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.goodness_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.iser_helper = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.iser_ip_address = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.iser_port = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.lvm_share_target = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.lvm_type = auto {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.num_shell_tries = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.replication_device = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.report_discard_supported = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.reserved_percentage = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.scst_target_driver = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.storage_protocol = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.target_helper = lioadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.target_ip_address = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.target_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.trace_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.use_chap_auth = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_clear = zero {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_clear_size = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] lvmdriver-1.volumes_dir = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_notifications.driver = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_notifications.retry = -1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] key_manager.fixed_key = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.barbican_api_version = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.barbican_endpoint = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.barbican_endpoint_type = public {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.barbican_region_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.number_of_retries = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.retry_delay = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.send_service_user_token = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.verify_ssl = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican.verify_ssl_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.auth_type = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] barbican_service_user.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.approle_role_id = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.approle_secret_id = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.kv_mountpoint = secret {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.kv_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.kv_version = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.root_token_id = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.ssl_ca_crt_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.timeout = 60.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:05 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] ******************************************************************************** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:15:06 devstack sudo[76169]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:06 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:06 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:06 devstack sudo[76174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:06 devstack sudo[76174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:07 devstack sudo[76174]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.669s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:15:07 devstack cinder-volume[76165]: INFO cinder.brick.local_dev.lvm [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:07 devstack sudo[76402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:07 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:07 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG cinder.brick.local_dev.lvm [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76165) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 17:15:07 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:07 devstack sudo[76649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:07 devstack sudo[76649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:09 devstack sudo[76649]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:09 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.494s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:09 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:09 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:09 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:09 devstack sudo[76935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:09 devstack sudo[76935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:10 devstack sudo[76935]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:10 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:10 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:10 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:10 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:10 devstack sudo[76949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 17:15:10 devstack sudo[76949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:10 devstack sudo[76949]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:10 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.680s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:10 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:10 devstack sudo[76953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:10 devstack sudo[76953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:11 devstack sudo[76953]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:11 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:11 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:11 devstack sudo[76957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:11 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:12 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:12 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:12 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:12 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:12 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:13 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:13 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.906s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:13 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:13 devstack sudo[76975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:13 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:13 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:13 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.785s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:13 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:13 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:13 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:13 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:13 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:14 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:14 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:14 devstack cinder-volume[76165]: INFO cinder.volume.drivers.lvm [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 17:15:14 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:14 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:14 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:14 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:14 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:15 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:15 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:15 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:15:15 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:15 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:15 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:15 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:15:15 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:16 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:16 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:16 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:16 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:16 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:16 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:16 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:16 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:16 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:17 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:17 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:17 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:17 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:17 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:17 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:17 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:18 devstack cinder-volume[76165]: INFO cinder.volume.driver [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG cinder.volume.driver [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76165) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG oslo_db.sqlalchemy.engines [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG dbcounter [-] [76165] Writer thread running {{(pid=76165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG cinder.db.api [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Building query based on filter {{(pid=76165) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG cinder.image.image_utils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76165) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:15:18 devstack cinder-volume[76165]: INFO cinder.keymgr.migration [None req-d64c9095-0efb-4e1d-8906-1170c866eda1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:18 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:18 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:18 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:18 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:18 devstack sudo[77266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:18 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:19 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:19 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:19 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:19 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:19 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:20 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:20 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:20 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:20 devstack sudo[77276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:20 devstack sudo[77276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:20 devstack sudo[77276]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:20 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:20 devstack cinder-volume[76165]: DEBUG cinder.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Notifying Schedulers of capabilities ... {{(pid=76165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:15:20 devstack cinder-volume[76165]: INFO cinder.volume.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Driver initialization completed successfully. Jul 07 17:15:20 devstack cinder-volume[76165]: INFO cinder.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Initiating service 2 cleanup Jul 07 17:15:20 devstack cinder-volume[76165]: INFO cinder.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Service 2 cleanup completed. Jul 07 17:15:20 devstack cinder-volume[76165]: DEBUG cinder.service [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Creating RPC server for service cinder-volume {{(pid=76165) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:15:20 devstack cinder-volume[76165]: DEBUG cinder.service [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76165) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:15:21 devstack cinder-volume[76165]: INFO cinder.volume.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 17:15:21 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:15:21 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:21 devstack sudo[77280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:15:21 devstack sudo[77280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:21 devstack sudo[77280]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:21 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:21 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:21 devstack sudo[77284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:21 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:22 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:22 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:22 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:22 devstack sudo[77292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:15:22 devstack sudo[77292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:23 devstack sudo[77292]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:23 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:23 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:23 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:15:23 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:23 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:23 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:23 devstack cinder-volume[76165]: INFO cinder.volume.manager [None req-2f591fe2-ef9b-4cc8-86b1-c7810da3b13e None None] Driver post RPC initialization completed successfully. Jul 07 17:15:30 devstack cinder-volume[76165]: DEBUG dbcounter [-] [76165] Writing DB stats cinder:SELECT=3 {{(pid=76165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:15:33 devstack cinder-volume[76165]: DEBUG dbcounter [-] [76165] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:15:36 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager._thread_info {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:15:36 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread count: 6 {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:15:36 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread info: [<_MainThread(MainThread, started 129217667846272)>, , , , , ] {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:16:36 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:16:36 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:16:36 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:36 devstack sudo[79626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:16:36 devstack sudo[79626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:37 devstack sudo[79626]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:37 devstack sudo[79629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:16:37 devstack sudo[79629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:38 devstack sudo[79629]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:38 devstack sudo[79632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:16:38 devstack sudo[79632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:38 devstack sudo[79632]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:38 devstack sudo[79662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:16:38 devstack sudo[79662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:39 devstack sudo[79662]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:39 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:39 devstack cinder-volume[76165]: DEBUG cinder.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Notifying Schedulers of capabilities ... {{(pid=76165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:16:39 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager._thread_info {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:16:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread count: 6 {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:16:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread info: [<_MainThread(MainThread, started 129217667846272)>, , , , , ] {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:17:33 devstack cinder-volume[76165]: DEBUG dbcounter [-] [76165] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:17:36 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:17:36 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:17:36 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:36 devstack sudo[82642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:17:36 devstack sudo[82642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:37 devstack sudo[82642]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:37 devstack sudo[82646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:17:37 devstack sudo[82646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:38 devstack sudo[82646]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:38 devstack sudo[82654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:17:38 devstack sudo[82654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:38 devstack sudo[82654]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:38 devstack sudo[82658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:17:38 devstack sudo[82658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:39 devstack sudo[82658]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:39 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:39 devstack cinder-volume[76165]: DEBUG cinder.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Notifying Schedulers of capabilities ... {{(pid=76165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:17:39 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager._thread_info {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:17:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread count: 6 {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:17:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread info: [<_MainThread(MainThread, started 129217667846272)>, , , , , ] {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:18:36 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:18:36 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:18:36 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:36 devstack sudo[84829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:18:36 devstack sudo[84829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:37 devstack sudo[84829]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:37 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:18:37 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:38 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:38 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:18:38 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:38 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.754s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:38 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:18:38 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:39 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:39 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:39 devstack cinder-volume[76165]: DEBUG cinder.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Notifying Schedulers of capabilities ... {{(pid=76165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:39 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager._thread_info {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:18:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread count: 6 {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:18:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread info: [<_MainThread(MainThread, started 129217667846272)>, , , , , ] {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:19:33 devstack cinder-volume[76165]: DEBUG dbcounter [-] [76165] Writing DB stats cinder:SELECT=1 {{(pid=76165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:19:33 devstack cinder-volume[76165]: DEBUG dbcounter [-] [76165] Writing DB stats cinder:UPDATE=1 {{(pid=76165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:19:36 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:19:36 devstack cinder-volume[76165]: DEBUG cinder.volume.drivers.lvm [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Updating volume stats {{(pid=76165) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:19:36 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:36 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:19:36 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:37 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:37 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:37 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:19:37 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:38 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:38 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:19:38 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:38 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:38 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:38 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:19:38 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:39 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:39 devstack cinder-volume[76165]: DEBUG oslo_concurrency.processutils [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:39 devstack cinder-volume[76165]: DEBUG cinder.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Notifying Schedulers of capabilities ... {{(pid=76165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:39 devstack cinder-volume[76165]: DEBUG oslo_service.periodic_task [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] Running periodic task VolumeManager._thread_info {{(pid=76165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:19:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread count: 6 {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:19:39 devstack cinder-volume[76165]: DEBUG cinder.volume.manager [None req-05dba44f-82d7-4ccd-b612-16b646391ce6 None None] thread info: [<_MainThread(MainThread, started 129217667846272)>, , , , , ] {{(pid=76165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:19:42 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Caught SIGTERM, stopping children Jul 07 17:19:42 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Acquiring lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:19:42 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Acquired lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:19:42 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Releasing lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:19:42 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Stop services. {{(pid=75996) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:19:42 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Killing children. {{(pid=75996) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:19:42 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Waiting on 1 children to exit Jul 07 17:19:46 devstack cinder-volume[76165]: DEBUG oslo_concurrency.lockutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Acquiring lock "singleton_lock" {{(pid=76165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:19:46 devstack cinder-volume[76165]: DEBUG oslo_concurrency.lockutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Acquired lock "singleton_lock" {{(pid=76165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:19:46 devstack cinder-volume[76165]: DEBUG oslo_concurrency.lockutils [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Releasing lock "singleton_lock" {{(pid=76165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:19:46 devstack cinder-volume[76165]: WARNING amqp [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:19:46 devstack cinder-volume[76165]: WARNING amqp [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:19:46 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-05060be3-af72-4af3-a1f3-6848971bbd20 None None] Child 76165 exited with status 0 Jul 07 17:19:46 devstack cinder-volume[86292]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:19:46 devstack cinder-volume[86292]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:19:46 devstack cinder-volume[86292]: we strongly recommend against using it for new projects. Jul 07 17:19:46 devstack cinder-volume[86292]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:19:46 devstack cinder-volume[86292]: framework. For more detail see Jul 07 17:19:46 devstack cinder-volume[86292]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:19:46 devstack cinder-volume[86292]: import eventlet # noqa Jul 07 17:19:48 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:19:48 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:19:48 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:19:49 devstack cinder-volume[86292]: INFO dbcounter [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Registered counter for database cinder Jul 07 17:19:49 devstack cinder-volume[86292]: DEBUG oslo_db.sqlalchemy.engines [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:19:49 devstack cinder-volume[86292]: DEBUG dbcounter [-] [86292] Writer thread running {{(pid=86292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:19:49 devstack cinder-volume[86292]: INFO cinder.rpc [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:19:49 devstack cinder-volume[86292]: INFO cinder.rpc [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:19:49 devstack cinder-volume[86292]: DEBUG oslo_db.sqlalchemy.engines [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:19:49 devstack cinder-volume[86292]: INFO cinder.volume.manager [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Determined volume DB was empty at startup. Jul 07 17:19:49 devstack cinder-volume[86292]: DEBUG cinder.volume.manager [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86292) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:19:49 devstack cinder-volume[86292]: INFO cinder.volume.manager [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:19:49 devstack cinder-volume[86292]: WARNING stevedore.named [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:19:49 devstack cinder-volume[86292]: WARNING castellan.key_manager [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:19:49 devstack cinder-volume[86292]: WARNING cinder.keymgr.conf_key_mgr [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:19:49 devstack cinder-volume[86292]: INFO cinder.volume.manager [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:19:49 devstack cinder-volume[86292]: DEBUG oslo_db.sqlalchemy.engines [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:19:50 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Starting 1 workers Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Started child 86509 {{(pid=86292) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Full set of CONF: {{(pid=86292) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] ******************************************************************************** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Configuration options gathered from: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] ================================================================================ {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] allow_availability_zone_fallback = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] allow_compression_on_image_upload = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86509]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] allowed_direct_url_schemes = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] api_rate_limit = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] auth_strategy = keystone {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_availability_zone = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_host = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_stats_polling_interval = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backup_api_class = cinder.backup.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backup_name_template = backup-%s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backup_use_same_host = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backup_use_temp_snapshot = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] chap_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] chap_username = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_internal_tenant_project_id = 40eb47350d1b49819d2d2ebbf3b8ad33 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_internal_tenant_user_id = 9c6bd7224908411e942e61dc6a3ce854 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cluster = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] compression_format = gzip {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] config_dir = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] config_source = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] control_exchange = openstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] debug = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] default_availability_zone = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] default_group_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] default_volume_type = QuobyteHD {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] disk_geometry = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] driver_client_cert = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] driver_client_cert_key = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] driver_data_namespace = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] driver_ssl_cert_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] driver_ssl_cert_verify = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] driver_use_ssl = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] enable_new_services = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] enable_unsupported_driver = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] enforce_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] filter_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_api_insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_api_ssl_compression = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_ca_certificates_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_num_retries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance_request_timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] goodness_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] graceful_shutdown_timeout = 5 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] group_api_class = cinder.group.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] host = devstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_compress_on_upload = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_conversion_address_space_limit = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_conversion_cpu_limit = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_conversion_disable = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_upload_use_cinder_backend = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_upload_use_internal_tenant = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_volume_cache_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_volume_cache_max_count = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] init_host_max_objects_retrieval = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] instance_format = [instance: %(uuid)s] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] iscsi_target_flags = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] iscsi_write_cache = on {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] iser_helper = tgtadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] iser_ip_address = 192.168.122.136 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] iser_port = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_color = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_config_append = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_dir = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_options = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_rotate_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_rotate_interval_type = days {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] log_rotation_type = none {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] max_age = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] max_logfile_count = 30 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] max_logfile_size_mb = 200 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] max_over_subscription_ratio = 20.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] message_reap_interval = 86400 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] message_ttl = 2592000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] monkey_patch = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] monkey_patch_modules = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] my_ip = 192.168.122.136 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] no_snapshot_gb_quota = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] num_iser_scan_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] num_shell_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] num_volume_device_scan_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] nvmeof_conn_info_version = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] nvmet_ns_id = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] nvmet_port_id = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_max_limit = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_volume_ext_list = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_volume_listen_port = 8776 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_volume_use_ssl = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] osapi_volume_workers = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] per_volume_size_limit = -1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] periodic_fuzzy_delay = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] periodic_interval = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] public_endpoint = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] publish_errors = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_backup_gigabytes = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_backups = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_gigabytes = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_groups = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_snapshots = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] quota_volumes = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] rate_limit_burst = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] rate_limit_except_level = CRITICAL {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] rate_limit_interval = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] reinit_driver_count = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] replication_device = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] report_discard_supported = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] report_interval = 120 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] reservation_clean_interval = 86400 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] reservation_expire = 86400 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.remotefs [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86509) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] reserved_image_namespaces = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] reserved_percentage = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] rpc_response_timeout = 120 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] run_external_periodic_tasks = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] scst_target_driver = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] scst_target_iqn_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_down_time = 720 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] shell_completion = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] snapshot_name_template = snapshot-%s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] split_loggers = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] state_path = /opt/stack/data/cinder {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] storage_availability_zone = nova {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] storage_protocol = iSCSI {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] syslog_log_facility = LOG_USER {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] target_helper = lioadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] target_ip_address = 192.168.122.136 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] target_port = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] target_protocol = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] target_secondary_ip_addresses = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] trace_flags = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] transport_url = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] until_refresh = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_chap_auth = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_default_quota_class = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_journal = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_json = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_stderr = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] use_syslog = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] verify_glance_signatures = enabled {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_api_class = cinder.volume.api.API {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_backend_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_clear = zero {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_clear_ionice = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_clear_size = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_copy_bps_limit = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_dd_blocksize = 1M {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_name_template = volume-%s {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_service_inithost_offload = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volume_usage_audit_period = month {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] zoning_mode = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.auth_section = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.auth_type = password {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.auth_version = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.cache = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.interface = public {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_password = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcache_username = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.region_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.service_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.backend = dogpile.cache.null {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.backend_argument = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.backend_expiration_time = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.config_prefix = cache.oslo {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.debug_cache_backend = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.enable_retry_client = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.enable_socket_keepalive = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.expiration_time = 600 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_dead_retry = 300 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_sasl_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.proxies = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.redis_db = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.redis_server = localhost:6379 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.retry_attempts = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.retry_delay = 0.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.socket_keepalive_count = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.socket_keepalive_idle = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.socket_keepalive_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.socket_timeout = 1.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.tls_allowed_ciphers = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.tls_cafile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.tls_certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.tls_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.tls_keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cache.username = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] coordination.backend_url = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.asyncio_connection = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.asyncio_slave_connection = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.backend = sqlalchemy {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.connection = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.connection_debug = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.connection_parameters = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.connection_recycle_time = 3600 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.connection_trace = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86509) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.db_inc_retry_interval = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.db_max_retries = 20 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: WARNING cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:19:50 devstack cinder-volume[86509]: WARNING cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.db_max_retry_interval = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.db_retry_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.max_overflow = 50 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.max_pool_size = 5 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.max_retries = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.pool_timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.retry_interval = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.slave_connection = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.sqlite_synchronous = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.synchronous_reader = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] database.use_db_reconnect = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.connection_string = messaging:// {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.es_doc_type = notification {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.es_scroll_size = 10000 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.es_scroll_time = 2m {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.filter_error_trace = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.hmac_keys = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.sentinel_service_name = mymaster {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.socket_timeout = 0.1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.trace_requests = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler.trace_sqlalchemy = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler_jaeger.process_tags = {} {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] profiler_otlp.service_name_prefix = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.enforce_scope = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.policy_default_rule = default {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.group = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.helper_command = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] privsep_osbrick.user = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.group = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.helper_command = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] cinder_sys_admin.user = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.auth_section = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.auth_type = password {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.cafile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.collect_timing = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.send_service_user_token = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.split_loggers = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] service_user.timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.auth_section = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.auth_type = password {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.collect_timing = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.region_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.split_loggers = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] glance.timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.backend_availability_zone = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.chap_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.chap_username = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.disk_geometry = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.driver_client_cert = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.driver_data_namespace = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.driver_use_ssl = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.extra_capabilities = {} {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.filter_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.goodness_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.iscsi_target_flags = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.iser_port = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_host = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_login = admin {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_mount_options = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_private_key = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_share_path = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.replication_device = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.report_discard_supported = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.target_helper = tgtadm {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.target_port = 3260 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.target_protocol = iscsi {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.trace_flags = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.use_chap_auth = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_backend_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_clear = zero {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_reports.file_event_handler = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_reports.log_dir = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.backend_host = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.chap_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.chap_username = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.disk_geometry = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.driver_client_cert = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.extra_capabilities = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.filter_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.goodness_function = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.iser_helper = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.iser_ip_address = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.iser_port = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_host = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_login = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_mount_options = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_password = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_private_key = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_share_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.num_shell_tries = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.replication_device = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.report_discard_supported = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.reserved_percentage = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.scst_target_driver = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.storage_protocol = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.target_helper = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.target_ip_address = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.target_port = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.target_prefix = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.target_protocol = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.trace_flags = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=86509) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.use_chap_auth = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: INFO cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 ... Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_clear = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f -c /etc/quobyte/client-cinder.cfg {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_clear_size = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] QuobyteHD.volumes_dir = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f -c /etc/quobyte/client-cinder.cfg Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_notifications.driver = [] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] key_manager.fixed_key = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.barbican_api_version = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.barbican_endpoint = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.barbican_endpoint_type = public {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.barbican_region_name = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.cafile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.collect_timing = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.number_of_retries = 60 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.retry_delay = 1 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.send_service_user_token = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.split_loggers = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.verify_ssl = True {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican.verify_ssl_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.auth_section = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.auth_type = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.cafile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.certfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.collect_timing = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.insecure = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.keyfile = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.split_loggers = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] barbican_service_user.timeout = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.approle_role_id = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.approle_secret_id = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.kv_mountpoint = secret {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.kv_path = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.kv_version = 2 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.namespace = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.root_token_id = **** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.ssl_ca_crt_file = None {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.timeout = 60.0 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.use_ssl = False {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:19:50 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] ******************************************************************************** {{(pid=86292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:19:51 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.785s {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:51 devstack cinder-volume[86509]: INFO cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 succeeded Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=86509) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.796s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:51 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:19:51 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:51 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.628s {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:51 devstack cinder-volume[86509]: INFO cinder.volume.driver [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG cinder.volume.driver [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545547485352, 'free_capacity_gb': 1775.7545547485352, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86509) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG dbcounter [-] [86509] Writer thread running {{(pid=86509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG cinder.db.api [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Building query based on filter {{(pid=86509) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG cinder.image.image_utils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86509) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:19:51 devstack cinder-volume[86509]: INFO cinder.keymgr.migration [None req-4ebfa838-c87f-45f6-a885-683f921b09b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=86509) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=86509) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:51 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:51 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:19:51 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:52 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.635s {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG cinder.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Notifying Schedulers of capabilities ... {{(pid=86509) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:52 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Driver initialization completed successfully. Jul 07 17:19:52 devstack cinder-volume[86509]: INFO cinder.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Initiating service 3 cleanup Jul 07 17:19:52 devstack cinder-volume[86509]: INFO cinder.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Service 3 cleanup completed. Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG cinder.service [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Creating RPC server for service cinder-volume {{(pid=86509) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG cinder.service [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86509) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:19:52 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=86509) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=86509) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:52 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:52 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:19:52 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:53 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:53 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.731s {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:53 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-715d71e1-163a-4ef3-b03b-51d6112d63b8 None None] Driver post RPC initialization completed successfully. Jul 07 17:19:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:57 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=86509) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:57 devstack cinder-volume[86509]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=86509) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86509) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:57 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:19:57 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:58 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:58 devstack cinder-volume[86509]: DEBUG oslo_concurrency.processutils [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.639s {{(pid=86509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:58 devstack cinder-volume[86509]: DEBUG cinder.manager [None req-bdfd12bb-6d24-43f0-99e1-59a60ed1e325 None None] Notifying Schedulers of capabilities ... {{(pid=86509) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:59 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Caught SIGTERM, stopping children Jul 07 17:19:59 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Acquiring lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:19:59 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Acquired lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:19:59 devstack cinder-volume[86292]: DEBUG oslo_concurrency.lockutils [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Releasing lock "singleton_lock" {{(pid=86292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:19:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Stop services. {{(pid=86292) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:19:59 devstack cinder-volume[86292]: DEBUG oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Killing children. {{(pid=86292) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:19:59 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Waiting on 1 children to exit Jul 07 17:20:00 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Acquiring lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:20:00 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Acquired lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:20:00 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Releasing lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:20:00 devstack cinder-volume[86509]: WARNING amqp [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:20:00 devstack cinder-volume[86509]: WARNING amqp [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:20:01 devstack cinder-volume[86292]: INFO oslo_service.backend._eventlet.service [None req-6632bf51-5294-444b-82d8-061ee62adbd8 None None] Child 86509 exited with status 0 Jul 07 17:20:01 devstack cinder-volume[86926]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:20:01 devstack cinder-volume[86926]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:20:01 devstack cinder-volume[86926]: we strongly recommend against using it for new projects. Jul 07 17:20:01 devstack cinder-volume[86926]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:20:01 devstack cinder-volume[86926]: framework. For more detail see Jul 07 17:20:01 devstack cinder-volume[86926]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:20:01 devstack cinder-volume[86926]: import eventlet # noqa Jul 07 17:20:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86926) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:20:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86926) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:20:04 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86926) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:20:05 devstack cinder-volume[86926]: INFO dbcounter [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Registered counter for database cinder Jul 07 17:20:05 devstack cinder-volume[86926]: DEBUG oslo_db.sqlalchemy.engines [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86926) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writer thread running {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:20:06 devstack cinder-volume[86926]: INFO cinder.rpc [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:20:06 devstack cinder-volume[86926]: INFO cinder.rpc [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_db.sqlalchemy.engines [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86926) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:20:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Determined volume DB was empty at startup. Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG cinder.volume.manager [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86926) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:20:06 devstack cinder-volume[86926]: WARNING stevedore.named [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:20:06 devstack cinder-volume[86926]: WARNING castellan.key_manager [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:20:06 devstack cinder-volume[86926]: WARNING cinder.keymgr.conf_key_mgr [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:20:06 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_db.sqlalchemy.engines [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86926) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:20:06 devstack cinder-volume[86926]: INFO oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Starting 1 workers Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Started child 87251 {{(pid=86926) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Full set of CONF: {{(pid=86926) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] ******************************************************************************** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] Configuration options gathered from: {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:20:06 devstack cinder-volume[87251]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] ================================================================================ {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] allow_availability_zone_fallback = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] allow_compression_on_image_upload = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] allowed_direct_url_schemes = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] api_rate_limit = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] auth_strategy = keystone {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_availability_zone = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_host = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_stats_polling_interval = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backup_api_class = cinder.backup.api.API {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backup_name_template = backup-%s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backup_use_same_host = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backup_use_temp_snapshot = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] chap_password = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] chap_username = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:06 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_internal_tenant_project_id = 40eb47350d1b49819d2d2ebbf3b8ad33 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_internal_tenant_user_id = 9c6bd7224908411e942e61dc6a3ce854 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cluster = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] compression_format = gzip {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] compute_api_class = cinder.compute.nova.API {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] config_dir = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] config_source = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] control_exchange = openstack {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] debug = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] default_availability_zone = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] default_group_type = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] default_volume_type = QuobyteHD {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] disk_geometry = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] driver_client_cert = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] driver_client_cert_key = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] driver_data_namespace = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] driver_ssl_cert_path = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] driver_ssl_cert_verify = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] driver_use_ssl = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] enable_new_services = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] enable_unsupported_driver = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] enabled_backends = ['QuobyteHD'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] enforce_multipath_for_image_xfer = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] filter_function = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_api_insecure = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_api_ssl_compression = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_ca_certificates_file = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_catalog_info = image:glance:publicURL {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_num_retries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance_request_timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] goodness_function = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] graceful_shutdown_timeout = 5 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] group_api_class = cinder.group.api.API {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] host = devstack {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_compress_on_upload = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_conversion_address_space_limit = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_conversion_cpu_limit = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_conversion_disable = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_upload_use_cinder_backend = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_upload_use_internal_tenant = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87251) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_volume_cache_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_volume_cache_max_count = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] image_volume_cache_max_size_gb = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] init_host_max_objects_retrieval = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] instance_format = [instance: %(uuid)s] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] iscsi_target_flags = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] iscsi_write_cache = on {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] iser_helper = tgtadm {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] iser_ip_address = 192.168.122.136 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] iser_port = 3260 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_color = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_config_append = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_dir = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_file = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_options = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_rotate_interval = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_rotate_interval_type = days {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] log_rotation_type = none {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] max_age = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] max_logfile_count = 30 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] max_logfile_size_mb = 200 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] max_over_subscription_ratio = 20.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] message_reap_interval = 86400 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] message_ttl = 2592000 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] migration_create_volume_timeout_secs = 300 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] monkey_patch = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] monkey_patch_modules = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] my_ip = 192.168.122.136 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] no_snapshot_gb_quota = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] num_iser_scan_tries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] num_shell_tries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] num_volume_device_scan_tries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] nvmeof_conn_info_version = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] nvmet_ns_id = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] nvmet_port_id = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_max_limit = 1000 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_volume_ext_list = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_volume_listen_port = 8776 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_volume_use_ssl = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] osapi_volume_workers = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] per_volume_size_limit = -1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] periodic_fuzzy_delay = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] periodic_interval = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] public_endpoint = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] publish_errors = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_backup_gigabytes = 1000 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_backups = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_gigabytes = 1000 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_groups = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_snapshots = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] quota_volumes = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] rate_limit_burst = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] rate_limit_except_level = CRITICAL {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] rate_limit_interval = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] reinit_driver_count = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] replication_device = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] report_discard_supported = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] report_interval = 120 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] reservation_clean_interval = 86400 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] reservation_expire = 86400 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] reserved_image_namespaces = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] reserved_percentage = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] rpc_response_timeout = 120 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] run_external_periodic_tasks = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] scst_target_driver = iscsi {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] scst_target_iqn_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_down_time = 720 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] shell_completion = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] snapshot_name_template = snapshot-%s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] split_loggers = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] state_path = /opt/stack/data/cinder {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] storage_availability_zone = nova {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] storage_protocol = iSCSI {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] syslog_log_facility = LOG_USER {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] target_helper = lioadm {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] target_ip_address = 192.168.122.136 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] target_port = 3260 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] target_protocol = iscsi {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] target_secondary_ip_addresses = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] trace_flags = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] transport_url = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] until_refresh = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_chap_auth = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87251) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:20:07 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:20:07 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_default_quota_class = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_journal = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_json = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_multipath_for_image_xfer = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_stderr = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] use_syslog = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] verify_glance_signatures = enabled {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_api_class = cinder.volume.api.API {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_backend_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_clear = zero {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_clear_ionice = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_clear_size = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_copy_bps_limit = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_dd_blocksize = 1M {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_name_template = volume-%s {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_service_inithost_offload = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volume_usage_audit_period = month {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] zoning_mode = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_concurrency.disable_process_locking = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.auth_section = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.auth_type = password {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.auth_version = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.cache = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.include_service_catalog = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.insecure = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.interface = public {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_password = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcache_username = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.region_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.service_type = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.backend = dogpile.cache.null {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.backend_argument = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.backend_expiration_time = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.config_prefix = cache.oslo {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.debug_cache_backend = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.enable_retry_client = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.enable_socket_keepalive = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.expiration_time = 600 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.hashclient_retry_attempts = 2 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_dead_retry = 300 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_pool_maxsize = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_sasl_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.password = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.proxies = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.redis_db = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.redis_server = localhost:6379 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.retry_attempts = 2 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.retry_delay = 0.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.socket_keepalive_count = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.socket_keepalive_idle = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.socket_keepalive_interval = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.socket_timeout = 1.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.tls_allowed_ciphers = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.tls_cafile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.tls_certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.tls_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.tls_keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cache.username = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] coordination.backend_url = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.asyncio_connection = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.asyncio_slave_connection = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.backend = sqlalchemy {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.connection = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.connection_debug = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.connection_parameters = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.connection_recycle_time = 3600 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.connection_trace = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.db_inc_retry_interval = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.db_max_retries = 20 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.db_max_retry_interval = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.db_retry_interval = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.max_overflow = 50 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.max_pool_size = 5 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.max_retries = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.mysql_wsrep_sync_wait = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.pool_timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.retry_interval = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.slave_connection = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.sqlite_synchronous = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.synchronous_reader = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] database.use_db_reconnect = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.connection_string = messaging:// {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.es_doc_type = notification {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.es_scroll_size = 10000 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.es_scroll_time = 2m {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.filter_error_trace = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.hmac_keys = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.sentinel_service_name = mymaster {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.socket_timeout = 0.1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.trace_requests = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler.trace_sqlalchemy = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler_jaeger.process_tags = {} {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler_jaeger.service_name_prefix = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] profiler_otlp.service_name_prefix = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.enforce_new_defaults = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.enforce_scope = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.policy_default_rule = default {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.policy_file = policy.yaml {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.group = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.helper_command = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] privsep_osbrick.user = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.group = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.helper_command = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] cinder_sys_admin.user = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.auth_section = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.auth_type = password {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.cafile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.collect_timing = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.insecure = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.send_service_user_token = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.split_loggers = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] service_user.timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.auth_section = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.auth_type = password {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.collect_timing = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.insecure = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.region_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.split_loggers = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] glance.timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.backend_availability_zone = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.chap_password = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.chap_username = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.disk_geometry = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.driver_client_cert = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.driver_client_cert_key = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.driver_data_namespace = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.driver_use_ssl = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.extra_capabilities = {} {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.filter_function = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.goodness_function = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.iscsi_target_flags = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.iscsi_write_cache = on {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.iser_helper = tgtadm {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.iser_port = 3260 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_host = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_login = admin {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_mount_options = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_password = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_private_key = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_share_path = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.num_shell_tries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.quobyte_volume_url = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.replication_device = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.report_discard_supported = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.reserved_percentage = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.target_helper = tgtadm {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.target_port = 3260 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.target_protocol = iscsi {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.trace_flags = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.unique_fqdn_network = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.use_chap_auth = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_backend_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_clear = zero {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_clear_ionice = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_clear_size = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_reports.file_event_handler = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_reports.log_dir = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.backend_availability_zone = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.backend_host = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.chap_password = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.chap_username = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.chiscsi_conf = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.disk_geometry = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.driver_client_cert = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.driver_data_namespace = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.driver_use_ssl = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.extra_capabilities = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.filter_function = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.goodness_function = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.iser_helper = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.iser_ip_address = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.iser_port = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.iser_target_prefix = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_host = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_login = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:07 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_mount_options = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_password = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_private_key = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_share_path = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_ssh_port = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.num_shell_tries = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.nvmet_port_id = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.replication_device = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.report_discard_supported = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.reserved_percentage = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.scst_target_driver = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.storage_protocol = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.target_helper = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.target_ip_address = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.target_port = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.target_prefix = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.target_protocol = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.trace_flags = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.use_chap_auth = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_clear = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_clear_size = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] QuobyteHD.volumes_dir = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_notifications.driver = [] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_notifications.retry = -1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] key_manager.fixed_key = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.barbican_api_version = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.barbican_endpoint = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.barbican_endpoint_type = public {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.barbican_region_name = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.cafile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.collect_timing = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.insecure = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.number_of_retries = 60 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.retry_delay = 1 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.send_service_user_token = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.split_loggers = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.verify_ssl = True {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican.verify_ssl_path = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.auth_section = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.auth_type = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.cafile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.certfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.collect_timing = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.insecure = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.keyfile = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.split_loggers = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] barbican_service_user.timeout = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.approle_role_id = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.approle_secret_id = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.kv_mountpoint = secret {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.kv_path = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.kv_version = 2 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.namespace = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.root_token_id = **** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.ssl_ca_crt_file = None {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.timeout = 60.0 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.use_ssl = False {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:20:08 devstack cinder-volume[86926]: DEBUG oslo_service.backend._eventlet.service [None req-79c885aa-a14e-4efa-8377-38b490c47e1c None None] ******************************************************************************** {{(pid=86926) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:20:08 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.873s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:08 devstack cinder-volume[87251]: INFO cinder.volume.driver [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.volume.driver [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540245056152, 'free_capacity_gb': 1775.7540245056152, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87251) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_db.sqlalchemy.engines [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writer thread running {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.db.api [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Building query based on filter {{(pid=87251) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87251) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:08 devstack cinder-volume[87251]: INFO cinder.keymgr.migration [None req-769a9fc3-bc20-4531-92a3-5da569af053a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:20:08 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:20:08 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:08 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.587s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Driver initialization completed successfully. Jul 07 17:20:08 devstack cinder-volume[87251]: INFO cinder.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Initiating service 3 cleanup Jul 07 17:20:08 devstack cinder-volume[87251]: INFO cinder.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Service 3 cleanup completed. Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.service [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Creating RPC server for service cinder-volume {{(pid=87251) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:20:08 devstack cinder-volume[87251]: DEBUG cinder.service [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87251) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:20:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:09 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:20:09 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:09 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.632s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e20f9bfb-aa32-4cb2-be52-1393e7f2c8e8 None None] Driver post RPC initialization completed successfully. Jul 07 17:20:16 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:18 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:19 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:20:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 6 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:20:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Flow 'volume_create_manager' (7e16a66f-fa92-4653-aa79-8c64932d4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc1eaa7-9cfb-4bfd-ad4a-1e5b9fb9fb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc1eaa7-9cfb-4bfd-ad4a-1e5b9fb9fb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-429070260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b4c0cc-8a71-48ad-a847-f6e873ee3f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a417ee198f024b558d9a0e602a28867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:22Z,use_quota=True,user_id='ec05ddbbcdd542c5b814411dcdc2d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4fe1a3-893c-484a-80d3-ddc7299c3d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4fe1a3-893c-484a-80d3-ddc7299c3d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649780e8-7e09-4090-b057-4bc082c3dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649780e8-7e09-4090-b057-4bc082c3dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b4c0cc-8a71-48ad-a847-f6e873ee3f70', 'volume_name': 'volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01eb6847-bc46-4d0b-abc1-103b1b732abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01eb6847-bc46-4d0b-abc1-103b1b732abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd926160-3b67-444c-8f59-184edf57d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:21 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Volume 10b4c0cc-8a71-48ad-a847-f6e873ee3f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70', 'volume_size': 1} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-429070260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b4c0cc-8a71-48ad-a847-f6e873ee3f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a417ee198f024b558d9a0e602a28867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:22Z,use_quota=True,user_id='ec05ddbbcdd542c5b814411dcdc2d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Creating volume 10b4c0cc-8a71-48ad-a847-f6e873ee3f70 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:21 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:21:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:21 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 1073741824 Jul 07 17:21:21 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:23 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 1073741824" returned: 0 in 1.365s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:23 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 Jul 07 17:21:23 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:24 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70" returned: 0 in 0.838s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd926160-3b67-444c-8f59-184edf57d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92781aa-af2b-4280-8fa5-f80ee6a49017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:24 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Volume volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 (10b4c0cc-8a71-48ad-a847-f6e873ee3f70): created successfully Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92781aa-af2b-4280-8fa5-f80ee6a49017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Flow 'volume_create_manager' (7e16a66f-fa92-4653-aa79-8c64932d4062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-93652009-5d49-4033-bf07-fc6a94f380b0 tempest-VolumesAdminNegativeTest-1530950629 None] Created volume successfully. Jul 07 17:21:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Acquiring lock "cinder-10b4c0cc-8a71-48ad-a847-f6e873ee3f70-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "cinder-10b4c0cc-8a71-48ad-a847-f6e873ee3f70-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Acquiring lock "cinder-quobyte-10b4c0cc-8a71-48ad-a847-f6e873ee3f70" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "cinder-quobyte-10b4c0cc-8a71-48ad-a847-f6e873ee3f70" acquired by "delete_volume" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:25 devstack cinder-volume[87251]: INFO oslo.privsep.daemon [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_wzitaxf/privsep.sock'] Jul 07 17:21:25 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_wzitaxf/privsep.sock Jul 07 17:21:25 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:21:26 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:21:27 devstack cinder-volume[87251]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 17:21:28 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:28 devstack cinder-volume[87251]: INFO oslo.privsep.daemon [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Spawned new privsep daemon via rootwrap Jul 07 17:21:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Accepted privsep connection to /tmp/tmp_wzitaxf/privsep.sock {{(pid=87251) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 17:21:28 devstack cinder-volume[87251]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 17:21:28 devstack cinder-volume[87251]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 17:21:28 devstack cinder-volume[87251]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 17:21:28 devstack cinder-volume[87251]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88195 Jul 07 17:21:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6a621-d2c8-461b-b0e5-0b09940f7237]: (2,) {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[699f0a59-4677-45c1-a8e5-2f95a0f53895]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:28 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 Jul 07 17:21:28 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:30 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70" returned: 0 in 2.073s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:30 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70 Jul 07 17:21:30 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:32 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-10b4c0cc-8a71-48ad-a847-f6e873ee3f70" returned: 0 in 1.348s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "cinder-quobyte-10b4c0cc-8a71-48ad-a847-f6e873ee3f70" released by "delete_volume" :: held 6.367s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:32 devstack cinder-volume[87251]: WARNING cinder.quota [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:32 devstack cinder-volume[87251]: WARNING cinder.quota [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Created reservations ['7215ba10-2237-4cfc-970a-352821584888', '7be394a0-9e27-4d05-8f1d-4c126b42bc14', '39ed5c33-cefd-4031-8e98-a3907a84bd9e', '9f28bf10-e521-4fe0-b835-aff22fdd8864'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:32 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:21:32 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:32 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:21:32 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:34 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.956s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Deleted volume successfully. Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-adf87c91-1b07-4d82-b4e0-e0b4673acbf1 tempest-VolumesAdminNegativeTest-1530950629 None] Lock "cinder-10b4c0cc-8a71-48ad-a847-f6e873ee3f70-delete_volume" released by "delete_volume" :: held 9.036s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:34 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 2.190s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:21:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:21:42 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:21:44 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Flow 'volume_create_manager' (76291f7e-b3f6-4d12-b94c-b4efe38888f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798cfa6-f850-4ff5-b81f-b69dc2745205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798cfa6-f850-4ff5-b81f-b69dc2745205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1223517312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf821bf-6702-4fa7-a244-e654beedc251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362643cf32954bc3ac25fc3ac59a817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:58Z,use_quota=True,user_id='741899cff3ba48939c1ebc8adc60efa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9798dc63-efca-43e9-b8e6-3bdfde4de84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9798dc63-efca-43e9-b8e6-3bdfde4de84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecf0abf-8058-4ba1-823a-1a274178f2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecf0abf-8058-4ba1-823a-1a274178f2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf821bf-6702-4fa7-a244-e654beedc251', 'volume_name': 'volume-8bf821bf-6702-4fa7-a244-e654beedc251', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2391b4f5-e9b2-4f17-a7fd-554bbaedffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2391b4f5-e9b2-4f17-a7fd-554bbaedffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e35670-c0e2-4229-a40f-d4459d5792c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Volume 8bf821bf-6702-4fa7-a244-e654beedc251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf821bf-6702-4fa7-a244-e654beedc251', 'volume_size': 1} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1223517312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf821bf-6702-4fa7-a244-e654beedc251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362643cf32954bc3ac25fc3ac59a817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:58Z,use_quota=True,user_id='741899cff3ba48939c1ebc8adc60efa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Creating volume 8bf821bf-6702-4fa7-a244-e654beedc251 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:58 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:21:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:58 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 1073741824 Jul 07 17:21:58 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:59 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 1073741824" returned: 0 in 1.269s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:59 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 Jul 07 17:21:59 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:00 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251" returned: 0 in 1.017s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e35670-c0e2-4229-a40f-d4459d5792c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf821bf-6702-4fa7-a244-e654beedc251', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03681152-f07e-4cdb-af9f-3b1a962fff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Volume volume-8bf821bf-6702-4fa7-a244-e654beedc251 (8bf821bf-6702-4fa7-a244-e654beedc251): created successfully Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03681152-f07e-4cdb-af9f-3b1a962fff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Flow 'volume_create_manager' (76291f7e-b3f6-4d12-b94c-b4efe38888f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-28997b3d-9a5b-4c2f-8236-606b45001338 tempest-AttachVolumeNegativeTest-242484348 None] Created volume successfully. Jul 07 17:22:08 devstack cinder-volume[87251]: WARNING py.warnings [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 07 17:22:08 devstack cinder-volume[87251]: .first() Jul 07 17:22:08 devstack cinder-volume[87251]: Jul 07 17:22:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:08 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d9b42-f41f-44b0-9581-b31531ebd868]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:08 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 Jul 07 17:22:08 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Flow 'volume_create_manager' (8afd490d-e988-41a5-9742-41c8b54961b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6709f06-451b-43d2-92a9-99354526b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6709f06-451b-43d2-92a9-99354526b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-492963349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fa622a-96b8-4cc2-a18b-d8566c3106b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc979215be8e40588f1585344ecd33b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:09Z,use_quota=True,user_id='c122fa55d44b414bae9415c7585cd625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dad860e-1aaa-4073-a83d-aa79247354b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dad860e-1aaa-4073-a83d-aa79247354b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe6a33-86e3-4269-a874-9c0e8858398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe6a33-86e3-4269-a874-9c0e8858398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fa622a-96b8-4cc2-a18b-d8566c3106b2', 'volume_name': 'volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c5a931-b0ea-4e9f-a5c9-11bb418aa0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c5a931-b0ea-4e9f-a5c9-11bb418aa0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75eb384d-227b-4d27-b449-ed83ab96dd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Volume 35fa622a-96b8-4cc2-a18b-d8566c3106b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2', 'volume_size': 1} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:09 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251" returned: 0 in 1.149s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.189s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.148s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-492963349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fa622a-96b8-4cc2-a18b-d8566c3106b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc979215be8e40588f1585344ecd33b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:09Z,use_quota=True,user_id='c122fa55d44b414bae9415c7585cd625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Creating volume 35fa622a-96b8-4cc2-a18b-d8566c3106b2 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:09 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 1073741824 Jul 07 17:22:09 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-8bf821bf-6702-4fa7-a244-e654beedc251', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fcb8847-4fbb-495e-b405-b5a70773ce5e', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:22:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-357cb7b1-4667-4721-8777-26808bb24dda req-47f13dd6-b891-42a5-90ed-6c1e357fa8b3 tempest-AttachVolumeNegativeTest-242484348 None] attachment_update completed successfully. Jul 07 17:22:11 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 1073741824" returned: 0 in 1.289s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:11 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 Jul 07 17:22:11 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Flow 'volume_create_manager' (ea0e6a34-6252-4c1c-892b-bee5840bcb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b379254f-6a37-4f16-9312-46a672117c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b379254f-6a37-4f16-9312-46a672117c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-964575898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3863a4fb-6284-4152-8881-27f24fc93aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b465c8d277514e7b8c708b44b85302e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:11Z,use_quota=True,user_id='60813547ccb244a0bc90ca8c6292aa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac8b946-dcae-4e85-b576-3a9047e3964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac8b946-dcae-4e85-b576-3a9047e3964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7da0eb-0ceb-4ad7-bb1e-3424d071fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7da0eb-0ceb-4ad7-bb1e-3424d071fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3863a4fb-6284-4152-8881-27f24fc93aa5', 'volume_name': 'volume-3863a4fb-6284-4152-8881-27f24fc93aa5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29928b53-2250-4a15-bb45-ff5cb9e4f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29928b53-2250-4a15-bb45-ff5cb9e4f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03dc0b0-eb0f-47cb-bf04-36172270a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Volume 3863a4fb-6284-4152-8881-27f24fc93aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3863a4fb-6284-4152-8881-27f24fc93aa5', 'volume_size': 1} Jul 07 17:22:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:12 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2" returned: 0 in 1.051s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] <== create_volume: return (2409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-964575898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3863a4fb-6284-4152-8881-27f24fc93aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b465c8d277514e7b8c708b44b85302e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:11Z,use_quota=True,user_id='60813547ccb244a0bc90ca8c6292aa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Creating volume 3863a4fb-6284-4152-8881-27f24fc93aa5 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:12 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75eb384d-227b-4d27-b449-ed83ab96dd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 1073741824 Jul 07 17:22:12 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9776a36-78c7-4c08-9bbf-2228df748a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Volume volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 (35fa622a-96b8-4cc2-a18b-d8566c3106b2): created successfully Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9776a36-78c7-4c08-9bbf-2228df748a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Flow 'volume_create_manager' (8afd490d-e988-41a5-9742-41c8b54961b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:12 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-74c20dad-dc30-4351-b2f1-a1e64c333b7d tempest-DeleteServersTestJSON-200117679 None] Created volume successfully. Jul 07 17:22:13 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 1073741824" returned: 0 in 1.109s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:13 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 Jul 07 17:22:13 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:14 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5" returned: 0 in 0.718s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03dc0b0-eb0f-47cb-bf04-36172270a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3863a4fb-6284-4152-8881-27f24fc93aa5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a1ac59-252f-4eea-809f-332bbcb23f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:14 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Volume volume-3863a4fb-6284-4152-8881-27f24fc93aa5 (3863a4fb-6284-4152-8881-27f24fc93aa5): created successfully Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a1ac59-252f-4eea-809f-332bbcb23f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Flow 'volume_create_manager' (ea0e6a34-6252-4c1c-892b-bee5840bcb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ad852029-fd3e-4b84-b195-9877a4abc374 tempest-ServersNegativeTestJSON-1842406983 None] Created volume successfully. Jul 07 17:22:16 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Flow 'volume_create_manager' (771a2ff0-991e-43cc-9c4f-a52a0b19b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4703d8cb-d36e-4187-8b65-2cc9975d407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4703d8cb-d36e-4187-8b65-2cc9975d407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-417464781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b465c8d277514e7b8c708b44b85302e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:17Z,use_quota=True,user_id='60813547ccb244a0bc90ca8c6292aa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90204ea-44cd-49c1-a376-608e9de3fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90204ea-44cd-49c1-a376-608e9de3fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8664ad38-8dc3-40f2-a618-52c78f5b369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8664ad38-8dc3-40f2-a618-52c78f5b369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b', 'volume_name': 'volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5057d-4f5a-404e-b6d8-d169abfb67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5057d-4f5a-404e-b6d8-d169abfb67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b6a50b-804d-469a-925e-6791de88f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Volume cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b', 'volume_size': 1} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-417464781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b465c8d277514e7b8c708b44b85302e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:17Z,use_quota=True,user_id='60813547ccb244a0bc90ca8c6292aa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Creating volume cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:17 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:17 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b 1073741824 Jul 07 17:22:17 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:18 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b 1073741824" returned: 0 in 1.483s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:18 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b Jul 07 17:22:18 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:19 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b" returned: 0 in 1.121s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.700s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.061s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b6a50b-804d-469a-925e-6791de88f97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f316e4e6-ce91-4db9-815c-81b30fdd1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6465df-dfd6-4530-9a32-91e32ac85768]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:20 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Volume volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b (cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b): created successfully Jul 07 17:22:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f316e4e6-ce91-4db9-815c-81b30fdd1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Flow 'volume_create_manager' (771a2ff0-991e-43cc-9c4f-a52a0b19b714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5b23abf3-de2e-41d0-81cf-e28c5f9b9774 tempest-ServersNegativeTestJSON-1842406983 None] Created volume successfully. Jul 07 17:22:20 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 Jul 07 17:22:20 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:21 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2" returned: 0 in 1.120s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.161s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33e24236-1d86-42d7-9613-013df5ad6b22', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:22:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-46e194bc-be98-4caf-af92-345007864bac req-7b5fa42f-0e6c-42f1-81e6-872f2300fb64 tempest-DeleteServersTestJSON-200117679 None] attachment_update completed successfully. Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "cinder-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "cinder-quobyte-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-quobyte-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d5b88f-da4d-463a-8512-739a09af8755]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:21 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b Jul 07 17:22:21 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:22 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b" returned: 0 in 0.915s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:22 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b Jul 07 17:22:22 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:23 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b" returned: 0 in 0.803s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-quobyte-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b" released by "delete_volume" :: held 1.764s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Created reservations ['a118a19f-afc6-4d7c-9ee9-839224da50ef', '1780baaf-3eec-4067-9a87-8806e2ce854e', '4c504ac7-c2a3-49d9-9ec2-fc7f87b9bdf4', '67b7264b-2cef-45aa-9d63-7e04d0b095e7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:23 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:22:23 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "cinder-3863a4fb-6284-4152-8881-27f24fc93aa5-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-3863a4fb-6284-4152-8881-27f24fc93aa5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "cinder-quobyte-3863a4fb-6284-4152-8881-27f24fc93aa5" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-quobyte-3863a4fb-6284-4152-8881-27f24fc93aa5" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e9278-64c9-45df-8309-5a79abddb02e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:24 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 Jul 07 17:22:24 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:24 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.725s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Deleted volume successfully. Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3af30ed5-58fa-4cf2-ad60-adff15398908 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-cbcd2af7-b6b4-4e03-bc9c-ce5a692e8b3b-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:24 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5" returned: 0 in 0.913s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:25 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5 Jul 07 17:22:25 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:25 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3863a4fb-6284-4152-8881-27f24fc93aa5" returned: 0 in 0.682s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-quobyte-3863a4fb-6284-4152-8881-27f24fc93aa5" released by "delete_volume" :: held 1.639s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Created reservations ['467a3714-d021-4fc8-b851-8241548fe2a5', 'e7e619e8-04b9-4070-a134-5a7e6fbdee9b', '78a83755-c258-4a14-80fe-1d1afaa27bdf', '2020f86e-019d-4437-bdf0-f76622161e4c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:25 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:22:25 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:27 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.189s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:27 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Deleted volume successfully. Jul 07 17:22:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4fe0936c-fd2a-42f1-aded-00cea0adb011 tempest-ServersNegativeTestJSON-1842406983 None] Lock "cinder-3863a4fb-6284-4152-8881-27f24fc93aa5-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:32 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:22:32 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:33 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.800s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-bf56a0d3-1267-4252-8286-e446d70affac req-e6bc5501-4f93-435b-9e8b-1f8d830ad190 tempest-DeleteServersTestJSON-200117679 None] Terminate volume connection completed successfully. Jul 07 17:22:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-bf56a0d3-1267-4252-8286-e446d70affac req-e6bc5501-4f93-435b-9e8b-1f8d830ad190 tempest-DeleteServersTestJSON-200117679 None] Deleting attachment 33e24236-1d86-42d7-9613-013df5ad6b22. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Flow 'volume_create_manager' (303c0bdd-177e-4dd5-8912-b1bd582ad0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecd1b5f-22a0-4da6-bc93-91acaee93bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecd1b5f-22a0-4da6-bc93-91acaee93bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1688667505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7c81b4-4baa-4aa3-a0a1-34929c8e783f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e671344d2f2c42cba354515f5ed8092b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:37Z,use_quota=True,user_id='6995aacbedd44fc0adbc4bea68734377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018ea717-daa1-45e1-989e-0e33baa9d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018ea717-daa1-45e1-989e-0e33baa9d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6590682d-519e-4e43-a246-eb6b666c784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6590682d-519e-4e43-a246-eb6b666c784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7c81b4-4baa-4aa3-a0a1-34929c8e783f', 'volume_name': 'volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4064389-7e2c-482f-8129-b9ef59b9c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4064389-7e2c-482f-8129-b9ef59b9c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34817b49-24b0-4973-a1cd-a7794d0b8838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:37 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Volume 7a7c81b4-4baa-4aa3-a0a1-34929c8e783f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f', 'volume_size': 1} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1688667505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7c81b4-4baa-4aa3-a0a1-34929c8e783f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e671344d2f2c42cba354515f5ed8092b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:37Z,use_quota=True,user_id='6995aacbedd44fc0adbc4bea68734377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Creating volume 7a7c81b4-4baa-4aa3-a0a1-34929c8e783f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:37 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:22:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:37 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f 1073741824 Jul 07 17:22:37 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:38 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f 1073741824" returned: 0 in 1.017s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:38 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f Jul 07 17:22:38 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:39 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" returned: 0 in 0.766s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34817b49-24b0-4973-a1cd-a7794d0b8838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7908c38c-e9bd-40d4-933b-95adc2bc6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:39 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Volume volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f (7a7c81b4-4baa-4aa3-a0a1-34929c8e783f): created successfully Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7908c38c-e9bd-40d4-933b-95adc2bc6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Flow 'volume_create_manager' (303c0bdd-177e-4dd5-8912-b1bd582ad0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a8ab1497-ef02-4e44-8e45-26890b28eeb1 tempest-TaggedAttachmentsTest-1797975208 None] Created volume successfully. Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Acquiring lock "cinder-35fa622a-96b8-4cc2-a18b-d8566c3106b2-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Lock "cinder-35fa622a-96b8-4cc2-a18b-d8566c3106b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Acquiring lock "cinder-quobyte-35fa622a-96b8-4cc2-a18b-d8566c3106b2" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Lock "cinder-quobyte-35fa622a-96b8-4cc2-a18b-d8566c3106b2" acquired by "delete_volume" :: waited 0.042s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:40 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[506437ee-3628-4073-a41e-b4cfcde39468]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:40 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 Jul 07 17:22:40 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:41 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2" returned: 0 in 1.413s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:41 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2 Jul 07 17:22:41 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:42 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-35fa622a-96b8-4cc2-a18b-d8566c3106b2" returned: 0 in 1.279s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Lock "cinder-quobyte-35fa622a-96b8-4cc2-a18b-d8566c3106b2" released by "delete_volume" :: held 2.763s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Created reservations ['c85cb4b6-67b7-4396-91c5-13c282a9752d', 'df6bf283-8fc6-4c0d-8099-a628bcba7a27', '3d64921d-7bbd-477e-b706-092044897e64', 'f416be62-e68a-4f0d-aa38-71bf998528f4'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:43 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:22:43 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:43 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.894s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Deleted volume successfully. Jul 07 17:22:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-604ddc31-8a8d-4d26-88fb-d6523dfc766f tempest-DeleteServersTestJSON-200117679 None] Lock "cinder-35fa622a-96b8-4cc2-a18b-d8566c3106b2-delete_volume" released by "delete_volume" :: held 4.004s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Flow 'volume_create_manager' (b143ed6c-3381-4de0-95b5-14446280137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42585ae-474b-418f-9eb1-5415c54a2149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42585ae-474b-418f-9eb1-5415c54a2149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1191332168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944bca79-0db2-4c47-ab68-7e2aab206c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4925b74af4865afbfd38e73cbe640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:50Z,use_quota=True,user_id='4621bc9f161343cd964dd6939923c832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61574792-c839-481f-abed-432c6f6c9504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61574792-c839-481f-abed-432c6f6c9504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0ad450-554a-4c4c-86a3-ffbddd2c7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0ad450-554a-4c4c-86a3-ffbddd2c7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944bca79-0db2-4c47-ab68-7e2aab206c19', 'volume_name': 'volume-944bca79-0db2-4c47-ab68-7e2aab206c19', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a090c3af-49d3-41f3-b330-d95e62ed2a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a090c3af-49d3-41f3-b330-d95e62ed2a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30496c26-fac5-4dd2-a259-d3afbec0f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:50 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Volume 944bca79-0db2-4c47-ab68-7e2aab206c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944bca79-0db2-4c47-ab68-7e2aab206c19', 'volume_size': 1} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1191332168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944bca79-0db2-4c47-ab68-7e2aab206c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4925b74af4865afbfd38e73cbe640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:50Z,use_quota=True,user_id='4621bc9f161343cd964dd6939923c832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Creating volume 944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:50 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:22:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:50 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 1073741824 Jul 07 17:22:50 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:51 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 1073741824" returned: 0 in 1.224s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:51 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 Jul 07 17:22:51 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:52 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19" returned: 0 in 0.941s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30496c26-fac5-4dd2-a259-d3afbec0f32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944bca79-0db2-4c47-ab68-7e2aab206c19', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e784fd-20a2-4e86-b466-c7de18994851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:52 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Volume volume-944bca79-0db2-4c47-ab68-7e2aab206c19 (944bca79-0db2-4c47-ab68-7e2aab206c19): created successfully Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e784fd-20a2-4e86-b466-c7de18994851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Flow 'volume_create_manager' (b143ed6c-3381-4de0-95b5-14446280137e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:52 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-e1971169-c497-47ad-8f1f-a7a96cf56312 req-491b2b67-767e-4cde-99aa-2ad9a5303511 tempest-VolumesSnapshotsTestJSON-1254047290 None] Created volume successfully. Jul 07 17:22:53 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=45,cinder:SELECT=37,cinder:INSERT=8,cinder:DELETE=8 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:22:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Creating offline snapshot dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd of volume 944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47e3af-62bf-45fe-84f8-7c1638fec1f6]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:54 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 Jul 07 17:22:54 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:55 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19" returned: 0 in 1.125s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:55 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd 1G Jul 07 17:22:55 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:56 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd 1G" returned: 0 in 0.996s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944bca79-0db2-4c47-ab68-7e2aab206c19 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:56 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944bca79-0db2-4c47-ab68-7e2aab206c19 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd Jul 07 17:22:56 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:56 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944bca79-0db2-4c47-ab68-7e2aab206c19 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" returned: 0 in 0.763s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:56 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd is being set with open permissions: ugo+rw Jul 07 17:22:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:56 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd Jul 07 17:22:56 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:57 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" returned: 0 in 0.653s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:57 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=45,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:22:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:57 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info Jul 07 17:22:57 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:58 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info" returned: 0 in 0.729s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:58 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info is being set with open permissions: ugo+rw Jul 07 17:22:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:58 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info Jul 07 17:22:58 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:59 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.info" returned: 0 in 0.869s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.273s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-eb943fed-5c71-4234-af4c-be7a0429847c req-69ab97e4-d217-468f-9fb6-b0c866a11d6d tempest-VolumesSnapshotsTestJSON-1254047290 None] Create snapshot completed successfully Jul 07 17:22:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "cinder-dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "cinder-quobyte-944bca79-0db2-4c47-ab68-7e2aab206c19" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-quobyte-944bca79-0db2-4c47-ab68-7e2aab206c19" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "cinder-quobyte-dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-quobyte-dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Deleting offline snapshot dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd of volume 944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] snapshot_file for this snap is: volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf0770-f18d-46b9-bebd-80879232b87a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:00 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd Jul 07 17:23:00 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" returned: 0 in 1.334s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944bca79-0db2-4c47-ab68-7e2aab206c19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:01 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:01 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc60677-de31-44cb-afeb-f3e3c166f35c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:01 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 Jul 07 17:23:01 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:02 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19" returned: 0 in 1.077s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:02 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd Jul 07 17:23:02 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:03 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" returned: 0 in 1.007s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:03 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd Jul 07 17:23:03 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:04 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19.dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" returned: 0 in 1.013s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-quobyte-dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd" released by "_delete_snapshot" :: held 4.628s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-quobyte-944bca79-0db2-4c47-ab68-7e2aab206c19" released by "delete_snapshot" :: held 4.684s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:04 devstack cinder-volume[87251]: WARNING cinder.quota [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:04 devstack cinder-volume[87251]: DEBUG cinder.quota [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Created reservations ['09ee8a83-6f65-4ec8-a1d4-e97e5529f7c5', 'c1148c1e-fa47-4e5e-a1de-7e1fac9f3f65', '6716cc70-5c85-4330-850f-44b8dfdf5400', '35f54750-e3cd-4e97-a94f-116e2d9b9d17'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Delete snapshot completed successfully. Jul 07 17:23:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-a8dc519c-7504-417c-9e43-2f689e872a84 req-8fb35e1f-32b0-4576-85cd-695b14b82ffa tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-dee3a7bb-e0da-4cd2-a0ec-8aef2280a4cd-delete_snapshot" released by "delete_snapshot" :: held 4.918s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "cinder-944bca79-0db2-4c47-ab68-7e2aab206c19-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-944bca79-0db2-4c47-ab68-7e2aab206c19-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "cinder-quobyte-944bca79-0db2-4c47-ab68-7e2aab206c19" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-quobyte-944bca79-0db2-4c47-ab68-7e2aab206c19" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24b0de3-e67b-49b0-b47e-5a84f2c1db10]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:05 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 Jul 07 17:23:05 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:06 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19" returned: 0 in 1.106s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:06 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19 Jul 07 17:23:06 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:07 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-944bca79-0db2-4c47-ab68-7e2aab206c19" returned: 0 in 0.886s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-quobyte-944bca79-0db2-4c47-ab68-7e2aab206c19" released by "delete_volume" :: held 2.083s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:07 devstack cinder-volume[87251]: DEBUG cinder.quota [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Created reservations ['9635ebcd-218d-45b1-8d16-d5c3c0cc51d6', '71493f43-6a37-4de9-8662-e273fc55b892', '667e46d1-31e2-40cd-8d78-7fcce6688dba', '83c6e026-3115-4fcb-a4f7-d1c25c202931'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:08 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:23:08 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:09 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.706s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:09 devstack cinder-volume[87251]: DEBUG cinder.manager [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Deleted volume successfully. Jul 07 17:23:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-06484d18-ec87-4f2c-a906-55632cba5781 req-d10ac0b8-a24e-4913-9bf5-9ce2a321b692 tempest-VolumesSnapshotsTestJSON-1254047290 None] Lock "cinder-944bca79-0db2-4c47-ab68-7e2aab206c19-delete_volume" released by "delete_volume" :: held 4.136s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-93f7fe3d-f7c2-4ea6-97f7-ba1d9e38b86a tempest-GroupSnapshotsTest-449809021 None] Group tempest-GroupSnapshotsTest-Group-1830760017: creating Jul 07 17:23:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-93f7fe3d-f7c2-4ea6-97f7-ba1d9e38b86a tempest-GroupSnapshotsTest-449809021 None] Group tempest-GroupSnapshotsTest-Group-1830760017: created successfully Jul 07 17:23:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-93f7fe3d-f7c2-4ea6-97f7-ba1d9e38b86a tempest-GroupSnapshotsTest-449809021 None] Create group completed successfully. Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (33a88ed3-39a8-4988-b248-861a2e585cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932cbba5-511e-4867-8af2-81153eb94fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932cbba5-511e-4867-8af2-81153eb94fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847409056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=daa9da75-6505-45f3-8751-c5c6c6ebabab,host='devstack@QuobyteHD#QuobyteHD',id=5e0d3790-9c36-489a-a358-c792adec27c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:16Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be7a3b4a-6975-49b3-88eb-dc419d03f393),volume_type_id=be7a3b4a-6975-49b3-88eb-dc419d03f393)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4db287-08c3-4d08-a288-8bf4d6626539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4db287-08c3-4d08-a288-8bf4d6626539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388dbf54-df42-49b4-a963-f8d211e1c297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388dbf54-df42-49b4-a963-f8d211e1c297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0d3790-9c36-489a-a358-c792adec27c0', 'volume_name': 'volume-5e0d3790-9c36-489a-a358-c792adec27c0', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08e35f0-4ae4-4361-93ec-6d350b5dac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08e35f0-4ae4-4361-93ec-6d350b5dac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b60f70-8022-442b-9888-c59815ab7060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:16 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Volume 5e0d3790-9c36-489a-a358-c792adec27c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0d3790-9c36-489a-a358-c792adec27c0', 'volume_size': 1} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=daa9da75-6505-45f3-8751-c5c6c6ebabab,created_at=2026-07-07T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847409056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=daa9da75-6505-45f3-8751-c5c6c6ebabab,host='devstack@QuobyteHD#QuobyteHD',id=5e0d3790-9c36-489a-a358-c792adec27c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:16Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be7a3b4a-6975-49b3-88eb-dc419d03f393),volume_type_id=be7a3b4a-6975-49b3-88eb-dc419d03f393)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Creating volume 5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:16 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:23:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:16 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 1073741824 Jul 07 17:23:16 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-94332cef-741c-48a6-af69-a3345c5d8db5 req-9225fdf0-28b7-4a67-81cc-cb4446e22f71 tempest-AttachVolumeNegativeTest-242484348 None] Terminate volume connection completed successfully. Jul 07 17:23:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-94332cef-741c-48a6-af69-a3345c5d8db5 req-9225fdf0-28b7-4a67-81cc-cb4446e22f71 tempest-AttachVolumeNegativeTest-242484348 None] Deleting attachment 1fcb8847-4fbb-495e-b405-b5a70773ce5e. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:17 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 1073741824" returned: 0 in 1.075s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:17 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:17 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:18 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 0.826s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b60f70-8022-442b-9888-c59815ab7060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0d3790-9c36-489a-a358-c792adec27c0', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ac9cb-7bb4-4e54-bfb2-f603707174f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Volume volume-5e0d3790-9c36-489a-a358-c792adec27c0 (5e0d3790-9c36-489a-a358-c792adec27c0): created successfully Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ac9cb-7bb4-4e54-bfb2-f603707174f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (33a88ed3-39a8-4988-b248-861a2e585cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3a782948-0802-46ad-9e23-9ef65ea0fa64 tempest-GroupSnapshotsTest-449809021 None] Created volume successfully. Jul 07 17:23:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] GroupSnapshot 1a642a45-7a9c-4f1d-8fd1-963b5863c693: creating. Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Group snapshot 1a642a45-7a9c-4f1d-8fd1-963b5863c693: creating. {{(pid=87251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Creating offline snapshot 1311ba6e-310d-4913-9f72-74899d47268b of volume 5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:23:19 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41b9c9f-5c18-4249-be24-35d0b41df09e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:19 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:19 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:19 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 0.828s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:19 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b 1G Jul 07 17:23:19 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:20 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b 1G" returned: 0 in 0.970s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0d3790-9c36-489a-a358-c792adec27c0 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:20 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0d3790-9c36-489a-a358-c792adec27c0 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b Jul 07 17:23:20 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:21 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0d3790-9c36-489a-a358-c792adec27c0 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b" returned: 0 in 1.204s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:22 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:23:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:22 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b Jul 07 17:23:22 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:23 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b" returned: 0 in 1.197s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:23 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info Jul 07 17:23:23 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:24 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:24 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:23:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:24 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info Jul 07 17:23:24 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:24 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.info" returned: 0 in 0.718s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.827s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e9e05ce2-5134-47ef-82f1-d840199bfaf0 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 1a642a45-7a9c-4f1d-8fd1-963b5863c693: created successfully Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-1311ba6e-310d-4913-9f72-74899d47268b-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1311ba6e-310d-4913-9f72-74899d47268b-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Creating volume bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 from snapshot 1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] snapshot: 1311ba6e-310d-4913-9f72-74899d47268b, volume: bc4e71ba-e0c8-4681-adc4-4cbb0f511a84, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[462cf90a-7d8b-48e3-bfd3-d2957a890f22]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:26 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b Jul 07 17:23:26 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:27 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b" returned: 0 in 1.142s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0d3790-9c36-489a-a358-c792adec27c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:23:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:23:27 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a743026-b163-4637-9aa9-039b6c64da9a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:27 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:27 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:28 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 0.903s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:28 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:23:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:28 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 Jul 07 17:23:28 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:32 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:23:32 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:35 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 2.373s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:35 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:35 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:23:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:23:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:23:36 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=8,cinder:UPDATE=19 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:23:36 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=28,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:23:37 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" returned: 0 in 8.641s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d811ad5-db14-4b43-9070-1f5f597e9934]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:37 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:37 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:38 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 1.081s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:38 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:23:38 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Converted 1024.00 MB image at 118.49 MB/s Jul 07 17:23:38 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:23:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:38 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 Jul 07 17:23:38 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:39 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" returned: 0 in 0.659s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" released by "_copy_volume_from_snapshot" :: held 12.565s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1311ba6e-310d-4913-9f72-74899d47268b-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" released by "_create_volume_from_snapshot" :: held 12.630s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.659s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-22068d2c-50a3-4d8a-aa54-9b4d1b5fdd1b tempest-GroupSnapshotsTest-449809021 None] Create group from source-snapshot-1a642a45-7a9c-4f1d-8fd1-963b5863c693 completed successfully. Jul 07 17:23:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:40 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[feba65a0-ff4e-435c-81b3-70e7c94ff52e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:40 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 Jul 07 17:23:40 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:41 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" returned: 0 in 1.234s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:41 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84 Jul 07 17:23:41 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:42 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" returned: 0 in 0.694s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-bc4e71ba-e0c8-4681-adc4-4cbb0f511a84" released by "delete_volume" :: held 1.974s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['7a19183a-9b9e-4a80-977a-4f8f5d2a204d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:42 devstack cinder-volume[87251]: WARNING cinder.quota [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1876003970 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1876003970, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:42 devstack cinder-volume[87251]: WARNING cinder.quota [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1876003970 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1876003970, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['3821e1e9-7aad-4a7b-bfc2-168206a096fa', '734544a3-cc38-4ed7-a55e-6a80e306038e', 'ea261cb9-cf5d-4442-8ac6-afc068d4ae04', 'd8245466-5b42-4f69-90a9-e9e4d01f8d0a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:42 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:23:42 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 1a642a45-7a9c-4f1d-8fd1-963b5863c693: deleting Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 1a642a45-7a9c-4f1d-8fd1-963b5863c693: deleting {{(pid=87251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-5e0d3790-9c36-489a-a358-c792adec27c0" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-5e0d3790-9c36-489a-a358-c792adec27c0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-1311ba6e-310d-4913-9f72-74899d47268b" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1311ba6e-310d-4913-9f72-74899d47268b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Deleting offline snapshot 1311ba6e-310d-4913-9f72-74899d47268b of volume 5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] snapshot_file for this snap is: volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb4a19e-a51e-4971-a7bf-7cbfee3c708a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:42 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b Jul 07 17:23:42 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:43 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.814s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-552b2c9f-eac8-4930-a8f8-511b9fc7eb81 tempest-GroupSnapshotsTest-449809021 None] Delete group completed successfully. Jul 07 17:23:43 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b" returned: 0 in 0.882s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0d3790-9c36-489a-a358-c792adec27c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a3e177-1f7c-406b-be2d-bf2655368d93]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:43 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:43 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:44 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 1.199s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:44 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b Jul 07 17:23:44 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:45 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b" returned: 0 in 0.934s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:45 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b Jul 07 17:23:45 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:46 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0.1311ba6e-310d-4913-9f72-74899d47268b" returned: 0 in 0.715s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1311ba6e-310d-4913-9f72-74899d47268b" released by "_delete_snapshot" :: held 3.836s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-5e0d3790-9c36-489a-a358-c792adec27c0" released by "delete_snapshot" :: held 3.861s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:46 devstack cinder-volume[87251]: WARNING cinder.quota [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1876003970 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1876003970, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:23:46 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['0a5acbe9-a389-4ccc-936e-8703f0393b1f', '97932552-6dbb-4ace-8f63-54664e79cfe6', '62fa5c33-8b0b-4849-a6fb-7af5ad428907', '40d15061-186f-454c-b6e6-4f166a539ac1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46d0f810-e17f-4ef5-89c9-c3c7399a7147 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 1a642a45-7a9c-4f1d-8fd1-963b5863c693: deleted successfully Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb517c00-41a4-4fb9-a315-9fa0d8a962ba]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:47 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f Jul 07 17:23:47 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-5e0d3790-9c36-489a-a358-c792adec27c0" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-5e0d3790-9c36-489a-a358-c792adec27c0" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[45437f55-d2e1-4777-b4b0-5c30e66fba8f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:47 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:47 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:48 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" returned: 0 in 0.869s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23dabe38-b260-43ac-92cf-3c9a39334b95', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-a9f499ad-2507-4330-8b0c-3bbafd0d327c req-9cae0254-7e5f-4b7e-b33c-9d1e033784d7 tempest-TaggedAttachmentsTest-1797975208 None] attachment_update completed successfully. Jul 07 17:23:48 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 0.800s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:48 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0 Jul 07 17:23:48 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:49 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5e0d3790-9c36-489a-a358-c792adec27c0" returned: 0 in 0.771s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-5e0d3790-9c36-489a-a358-c792adec27c0" released by "delete_volume" :: held 1.639s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['c4a2f7e0-200d-4465-81d8-c10381e4c35c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:49 devstack cinder-volume[87251]: WARNING cinder.db.api [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1876003970'] Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['56073d88-e12d-49d2-8f8b-09025f7fc2dd', 'f63cd93d-da90-401e-8271-2f8f18c2fa53', '692d5238-585c-44b7-88b0-dd8f2ad9babb', 'a7d856e0-5834-4060-a89e-0dc6e6d8c2a1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:49 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:23:49 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Flow 'volume_create_manager' (76061d03-64a0-4561-a117-7195d5d0370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab62dd0d-1c66-48cf-b704-f1b0315658a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab62dd0d-1c66-48cf-b704-f1b0315658a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-314281713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629a4b3f-d41a-4d49-8869-f453bb83a1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc99bae9d794ce39e0935167c6ecada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:49Z,use_quota=True,user_id='6ec9d9d0ee7b4b1ba133b03e3dfe019b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfee70ae-0801-4268-8118-789dbc5f167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfee70ae-0801-4268-8118-789dbc5f167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c874b9-f212-45f7-9f7d-b03161cb8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c874b9-f212-45f7-9f7d-b03161cb8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629a4b3f-d41a-4d49-8869-f453bb83a1d5', 'volume_name': 'volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c89423-9d53-4da5-9993-8bc06cf53773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c89423-9d53-4da5-9993-8bc06cf53773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279da55-e071-4f92-92f6-3d2080ff47e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Volume 629a4b3f-d41a-4d49-8869-f453bb83a1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5', 'volume_size': 1} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-314281713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629a4b3f-d41a-4d49-8869-f453bb83a1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc99bae9d794ce39e0935167c6ecada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:49Z,use_quota=True,user_id='6ec9d9d0ee7b4b1ba133b03e3dfe019b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Creating volume 629a4b3f-d41a-4d49-8869-f453bb83a1d5 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:49 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:23:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:49 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 1073741824 Jul 07 17:23:49 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:50 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.363s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:50 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a2be9e55-6735-45bf-8351-b5b1c7736e62 tempest-GroupSnapshotsTest-449809021 None] Delete group completed successfully. Jul 07 17:23:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cc3064b0-e387-427b-9bb6-f2068cdb870c tempest-GroupSnapshotsTest-449809021 None] Group tempest-GroupSnapshotsTest-Group-2068890895: creating Jul 07 17:23:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cc3064b0-e387-427b-9bb6-f2068cdb870c tempest-GroupSnapshotsTest-449809021 None] Group tempest-GroupSnapshotsTest-Group-2068890895: created successfully Jul 07 17:23:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cc3064b0-e387-427b-9bb6-f2068cdb870c tempest-GroupSnapshotsTest-449809021 None] Create group completed successfully. Jul 07 17:23:51 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 1073741824" returned: 0 in 1.520s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:51 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 Jul 07 17:23:51 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:52 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5" returned: 0 in 0.741s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279da55-e071-4f92-92f6-3d2080ff47e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9976dc-2be9-453f-a0cd-6c99e8ce8635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:52 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Volume volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 (629a4b3f-d41a-4d49-8869-f453bb83a1d5): created successfully Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9976dc-2be9-453f-a0cd-6c99e8ce8635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Flow 'volume_create_manager' (76061d03-64a0-4561-a117-7195d5d0370b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:52 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9919db7a-82dc-4f02-8e71-d3199140d508 tempest-ServerActionsTestOtherA-1634437782 None] Created volume successfully. Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (a29ae8e5-130b-4f85-8f95-4c7b6e0217b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013c451e-b426-4ebf-b3de-bc269e739f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013c451e-b426-4ebf-b3de-bc269e739f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323806548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5433267-0463-4563-8255-f3a94bd473d4,host='devstack@QuobyteHD#QuobyteHD',id=e3ad5998-0de7-4e82-97aa-38c2c7d7f71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:53Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60d6d90-e8b5-40e9-80e5-52664b440d57),volume_type_id=a60d6d90-e8b5-40e9-80e5-52664b440d57)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7baacd11-51c8-4170-8dce-23c408ab5421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7baacd11-51c8-4170-8dce-23c408ab5421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedc7517-da02-4c3b-8710-eb9f31bec45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedc7517-da02-4c3b-8710-eb9f31bec45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ad5998-0de7-4e82-97aa-38c2c7d7f71b', 'volume_name': 'volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f6e906-c8f7-4177-bd10-45d838a05fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f6e906-c8f7-4177-bd10-45d838a05fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33d773f-a26f-4156-a1fa-df54717c4ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:53 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Volume e3ad5998-0de7-4e82-97aa-38c2c7d7f71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b', 'volume_size': 1} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5433267-0463-4563-8255-f3a94bd473d4,created_at=2026-07-07T15:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323806548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5433267-0463-4563-8255-f3a94bd473d4,host='devstack@QuobyteHD#QuobyteHD',id=e3ad5998-0de7-4e82-97aa-38c2c7d7f71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:53Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60d6d90-e8b5-40e9-80e5-52664b440d57),volume_type_id=a60d6d90-e8b5-40e9-80e5-52664b440d57)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Creating volume e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:53 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:23:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:53 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b 1073741824 Jul 07 17:23:53 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:54 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b 1073741824" returned: 0 in 1.278s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:54 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b Jul 07 17:23:54 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:55 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" returned: 0 in 0.753s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33d773f-a26f-4156-a1fa-df54717c4ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ef363b-97c3-49cf-af7e-c01226a6f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:55 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Volume volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b (e3ad5998-0de7-4e82-97aa-38c2c7d7f71b): created successfully Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ef363b-97c3-49cf-af7e-c01226a6f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (a29ae8e5-130b-4f85-8f95-4c7b6e0217b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dab2ed73-37d8-480f-9372-03445f41c096 tempest-GroupSnapshotsTest-449809021 None] Created volume successfully. Jul 07 17:23:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-bffdff47-21b0-46af-88db-4cccae6a0a68 req-247d79bc-a7ee-4476-aa4e-96d89e882c5f tempest-TaggedAttachmentsTest-1797975208 None] Terminate volume connection completed successfully. Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-bffdff47-21b0-46af-88db-4cccae6a0a68 req-247d79bc-a7ee-4476-aa4e-96d89e882c5f tempest-TaggedAttachmentsTest-1797975208 None] Deleting attachment 23dabe38-b260-43ac-92cf-3c9a39334b95. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (c15f443b-cbee-4d0a-9580-2051adbed731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845c8fea-1d47-4fa3-962e-ef541961cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845c8fea-1d47-4fa3-962e-ef541961cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117142031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5433267-0463-4563-8255-f3a94bd473d4,host='devstack@QuobyteHD#QuobyteHD',id=1ec5ebbf-274b-4d13-a5ed-0e62145994b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:56Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60d6d90-e8b5-40e9-80e5-52664b440d57),volume_type_id=a60d6d90-e8b5-40e9-80e5-52664b440d57)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442879e3-ce2d-4276-b8e5-9ea904a0877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442879e3-ce2d-4276-b8e5-9ea904a0877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c51801-b3d5-4dc7-a333-9d5972b60a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c51801-b3d5-4dc7-a333-9d5972b60a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec5ebbf-274b-4d13-a5ed-0e62145994b8', 'volume_name': 'volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2458de3b-6699-4c67-9d5e-239ec27d2d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2458de3b-6699-4c67-9d5e-239ec27d2d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2604c397-222e-410b-8f13-7575c238af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:56 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Volume 1ec5ebbf-274b-4d13-a5ed-0e62145994b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8', 'volume_size': 1} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5433267-0463-4563-8255-f3a94bd473d4,created_at=2026-07-07T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117142031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5433267-0463-4563-8255-f3a94bd473d4,host='devstack@QuobyteHD#QuobyteHD',id=1ec5ebbf-274b-4d13-a5ed-0e62145994b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:56Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60d6d90-e8b5-40e9-80e5-52664b440d57),volume_type_id=a60d6d90-e8b5-40e9-80e5-52664b440d57)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Creating volume 1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:56 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:23:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:56 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 1073741824 Jul 07 17:23:56 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:57 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 1073741824" returned: 0 in 1.023s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:57 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 Jul 07 17:23:57 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:58 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" returned: 0 in 0.709s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2604c397-222e-410b-8f13-7575c238af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596a23ff-2d31-4e76-b501-a20e5a5fe361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Volume volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 (1ec5ebbf-274b-4d13-a5ed-0e62145994b8): created successfully Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596a23ff-2d31-4e76-b501-a20e5a5fe361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (c15f443b-cbee-4d0a-9580-2051adbed731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3271c784-d92e-4a0e-bddb-910fae592956 tempest-GroupSnapshotsTest-449809021 None] Created volume successfully. Jul 07 17:23:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-61f5a9e9-2128-435a-8a34-c602604772c4 tempest-GroupSnapshotsTest-449809021 None] Update group completed successfully. Jul 07 17:24:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-beeab30e-8f92-45a9-9128-fd15d2e4becb tempest-GroupSnapshotsTest-449809021 None] Update group completed successfully. Jul 07 17:24:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-befbfdf7-2900-49b0-8a40-f8bbde40447a tempest-GroupSnapshotsTest-449809021 None] Update group completed successfully. Jul 07 17:24:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-547ccb65-2627-4993-b7c9-524ba6d64039 tempest-GroupSnapshotsTest-449809021 None] Update group completed successfully. Jul 07 17:24:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] GroupSnapshot 2aa187e5-7442-4fb1-a5e2-cec73a112b47: creating. Jul 07 17:24:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Group snapshot 2aa187e5-7442-4fb1-a5e2-cec73a112b47: creating. {{(pid=87251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:24:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Creating offline snapshot 0676e79e-9172-4bf1-938b-13fdea1ed3bb of volume 1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bd2024-36b0-4533-adce-5a2160f0b231]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:04 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 Jul 07 17:24:04 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:05 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" returned: 0 in 1.442s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:05 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb 1G Jul 07 17:24:05 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:06 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb 1G" returned: 0 in 0.888s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:06 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb Jul 07 17:24:06 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:07 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb" returned: 0 in 0.876s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:07 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:24:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:07 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb Jul 07 17:24:07 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:08 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb" returned: 0 in 0.859s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:08 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info Jul 07 17:24:08 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:09 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:09 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:24:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:09 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info Jul 07 17:24:09 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:10 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.info" returned: 0 in 0.828s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.780s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Creating offline snapshot 405f14f5-cd7d-470c-ad34-bd9a80fe93c2 of volume e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcfcec9-bca6-4466-b915-18e28787522f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:10 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b Jul 07 17:24:10 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:11 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" returned: 0 in 0.946s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:11 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 1G Jul 07 17:24:11 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 1G" returned: 0 in 0.892s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:12 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 Jul 07 17:24:12 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2" returned: 0 in 0.780s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:12 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:24:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:12 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 Jul 07 17:24:12 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:13 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2" returned: 0 in 0.863s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:13 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info Jul 07 17:24:13 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:14 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info" returned: 0 in 0.913s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:14 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:24:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:14 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info Jul 07 17:24:14 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:15 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.info" returned: 0 in 1.082s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.601s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Acquiring lock "cinder-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Lock "cinder-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46ea887f-affb-4921-936b-f30c748f1f26 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 2aa187e5-7442-4fb1-a5e2-cec73a112b47: created successfully Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Acquiring lock "cinder-quobyte-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Lock "cinder-quobyte-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[14229f2e-1720-4331-9a81-2f4066117c93]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 2aa187e5-7442-4fb1-a5e2-cec73a112b47: deleting Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 2aa187e5-7442-4fb1-a5e2-cec73a112b47: deleting {{(pid=87251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-0676e79e-9172-4bf1-938b-13fdea1ed3bb" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-0676e79e-9172-4bf1-938b-13fdea1ed3bb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Deleting offline snapshot 0676e79e-9172-4bf1-938b-13fdea1ed3bb of volume 1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:16 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f Jul 07 17:24:16 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] snapshot_file for this snap is: volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2aa4e1-6731-41e6-bc65-dd5ec383dd9a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:16 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb Jul 07 17:24:16 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:17 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Flow 'volume_create_manager' (52617935-948d-410d-99e6-a999e2d23f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942c10f8-c4b5-4534-a8d6-1c07a40129ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" returned: 0 in 1.121s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f Jul 07 17:24:17 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942c10f8-c4b5-4534-a8d6-1c07a40129ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2118095707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad865b85-0de7-41bc-9cc4-73079565b23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362643cf32954bc3ac25fc3ac59a817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:17Z,use_quota=True,user_id='741899cff3ba48939c1ebc8adc60efa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b31845f-4949-46a0-a5d0-6dfd56277b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b31845f-4949-46a0-a5d0-6dfd56277b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c42dadf-299b-4df3-83ab-21787fb6ec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c42dadf-299b-4df3-83ab-21787fb6ec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad865b85-0de7-41bc-9cc4-73079565b23a', 'volume_name': 'volume-ad865b85-0de7-41bc-9cc4-73079565b23a', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb38cbfb-4127-4616-ae50-7f0cc062c052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb38cbfb-4127-4616-ae50-7f0cc062c052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2cc225-0ec7-46ad-80ec-0a24d4e69daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Volume ad865b85-0de7-41bc-9cc4-73079565b23a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad865b85-0de7-41bc-9cc4-73079565b23a', 'volume_size': 1} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2118095707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad865b85-0de7-41bc-9cc4-73079565b23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362643cf32954bc3ac25fc3ac59a817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:17Z,use_quota=True,user_id='741899cff3ba48939c1ebc8adc60efa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Creating volume ad865b85-0de7-41bc-9cc4-73079565b23a {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:17 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a 1073741824 Jul 07 17:24:17 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:17 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb" returned: 0 in 1.168s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e30b8-8361-4b7d-9c8f-fe468c952e13]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:17 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 Jul 07 17:24:17 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:18 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" returned: 0 in 0.977s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Lock "cinder-quobyte-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f" released by "delete_volume" :: held 2.171s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Created reservations ['05234a19-7845-4fd6-8af2-3ecfd3ae3918', '315eca3d-9331-4173-ae45-735bd313e8de', '0bdc60f3-713d-4d8c-a1fc-27cdba17ce1c', '95e1931b-177c-4b54-8d21-3a8e6d0ffcb9'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:18 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:24:18 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:18 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a 1073741824" returned: 0 in 1.202s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:18 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" returned: 0 in 1.042s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:18 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a Jul 07 17:24:18 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:18 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb Jul 07 17:24:18 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:19 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Deleted volume successfully. Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b4d7e53a-bc74-4495-ac70-79440c9eabc2 tempest-TaggedAttachmentsTest-1797975208 None] Lock "cinder-7a7c81b4-4baa-4aa3-a0a1-34929c8e783f-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:19 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb" returned: 0 in 0.865s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:19 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb Jul 07 17:24:19 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:19 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a" returned: 0 in 1.019s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2cc225-0ec7-46ad-80ec-0a24d4e69daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad865b85-0de7-41bc-9cc4-73079565b23a', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564b3138-8690-4a5a-84f4-54f7023f9220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Volume volume-ad865b85-0de7-41bc-9cc4-73079565b23a (ad865b85-0de7-41bc-9cc4-73079565b23a): created successfully Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564b3138-8690-4a5a-84f4-54f7023f9220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Flow 'volume_create_manager' (52617935-948d-410d-99e6-a999e2d23f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b53f9347-8e32-43aa-9ae6-6bc386707bef tempest-AttachVolumeNegativeTest-242484348 None] Created volume successfully. Jul 07 17:24:20 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8.0676e79e-9172-4bf1-938b-13fdea1ed3bb" returned: 0 in 0.728s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-0676e79e-9172-4bf1-938b-13fdea1ed3bb" released by "_delete_snapshot" :: held 3.976s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" released by "delete_snapshot" :: held 4.011s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-405f14f5-cd7d-470c-ad34-bd9a80fe93c2" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-405f14f5-cd7d-470c-ad34-bd9a80fe93c2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Deleting offline snapshot 405f14f5-cd7d-470c-ad34-bd9a80fe93c2 of volume e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] snapshot_file for this snap is: volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[72386a34-c833-44c4-8727-e270ab0c1108]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:20 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 Jul 07 17:24:20 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:21 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2" returned: 0 in 0.801s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[923d96e7-f225-42ae-bc00-4d691ac0256a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:21 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b Jul 07 17:24:21 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:22 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" returned: 0 in 0.816s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:22 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 Jul 07 17:24:22 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:22 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2" returned: 0 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:22 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2 Jul 07 17:24:22 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa6290f-390f-4942-b54f-f9e0573d08f7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:23 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a Jul 07 17:24:23 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:23 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b.405f14f5-cd7d-470c-ad34-bd9a80fe93c2" returned: 0 in 0.741s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-405f14f5-cd7d-470c-ad34-bd9a80fe93c2" released by "_delete_snapshot" :: held 3.323s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" released by "delete_snapshot" :: held 3.356s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:23 devstack cinder-volume[87251]: WARNING cinder.quota [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2144961199 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2144961199, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:24:23 devstack cinder-volume[87251]: WARNING cinder.quota [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2144961199 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2144961199, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['7d0d03c8-23e4-46b2-b364-90a70190dbee', 'e335b827-51ac-4d06-813d-6365f30651e4', 'fff41907-645a-40a6-8b40-9ebf44386b68', '34b72ef3-01fe-4331-8042-e75ae4b120ec'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['2c6dce78-4907-415b-87fa-cc22401d879a', 'de47060a-9b85-4cec-aa6e-17de745cfd9c', 'b5f11c3c-8045-4ba9-b06a-a8ccfcc49b2e', 'd64ce89f-4429-4458-89e9-430d1a3b1d27'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b6b3f26b-6951-4d17-b5de-364d095cb8f6 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 2aa187e5-7442-4fb1-a5e2-cec73a112b47: deleted successfully Jul 07 17:24:24 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a" returned: 0 in 0.860s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-ad865b85-0de7-41bc-9cc4-73079565b23a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8111e6a1-7c7a-47cf-be8a-7f048daf7a86', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:24:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-242243ea-f599-4a77-ac85-33040b9d50a8 req-a9760d97-dc43-4414-9b37-afaa3d7b5899 tempest-AttachVolumeNegativeTest-242484348 None] attachment_update completed successfully. Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8836ef76-e597-4f44-adbc-032f7ad6ab59]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:24 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 Jul 07 17:24:24 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:25 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" returned: 0 in 0.897s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:25 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8 Jul 07 17:24:25 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:26 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-1ec5ebbf-274b-4d13-a5ed-0e62145994b8" released by "delete_volume" :: held 1.706s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d974498-d948-4fd5-993c-87ee0b7171b7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:26 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b Jul 07 17:24:26 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:27 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" returned: 0 in 0.985s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:27 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b Jul 07 17:24:27 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:28 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" returned: 0 in 0.771s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-e3ad5998-0de7-4e82-97aa-38c2c7d7f71b" released by "delete_volume" :: held 1.852s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['ee5afe98-5dce-42b7-9612-554d9a726a9f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:28 devstack cinder-volume[87251]: WARNING cinder.quota [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2144961199 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2144961199, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['585ac529-d806-4bf9-81e1-2b4a50b3bd87', '1043c00b-83e0-4abc-9b57-ebec3adc12d8', '5c320a10-02ae-4264-b6ba-da6060e17755', '601a8cff-2c7b-4f29-a976-a39e15de79b7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['3e5204fb-b406-4e82-905b-6c01828d18d5', '6b84bd6d-f743-4a29-b87a-05d0e161a348', 'fd7b942b-7a80-4114-9075-36ebdc94c910', 'cdea9a2b-dff5-464a-b028-fd13dd09fc90'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:28 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:24:28 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:29 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:29 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c6fdf106-f36e-462c-a860-2f3e35be5227 tempest-GroupSnapshotsTest-449809021 None] Delete group completed successfully. Jul 07 17:24:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dff61280-9d46-4aab-b13e-d03bd5f4e7a6 tempest-GroupSnapshotsTest-449809021 None] Group tempest-GroupSnapshotsTest-Group-1760026687: creating Jul 07 17:24:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dff61280-9d46-4aab-b13e-d03bd5f4e7a6 tempest-GroupSnapshotsTest-449809021 None] Group tempest-GroupSnapshotsTest-Group-1760026687: created successfully Jul 07 17:24:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dff61280-9d46-4aab-b13e-d03bd5f4e7a6 tempest-GroupSnapshotsTest-449809021 None] Create group completed successfully. Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (fde2909f-e0e8-4652-ad89-d0d8e67bf86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d88b46-2ee0-470f-accb-3545b2ac5967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d88b46-2ee0-470f-accb-3545b2ac5967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978664351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ac55d3f-a8af-473b-9560-e41f7566599d,host='devstack@QuobyteHD#QuobyteHD',id=8aef594f-ebc1-42fb-81d0-32455b5be206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:32Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44726995-1e1a-4baa-ab9b-554d8e7af901),volume_type_id=44726995-1e1a-4baa-ab9b-554d8e7af901)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e25177-688f-46b3-b2ba-9712a5aa1b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e25177-688f-46b3-b2ba-9712a5aa1b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24372f81-98be-4e80-883b-19715249a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24372f81-98be-4e80-883b-19715249a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aef594f-ebc1-42fb-81d0-32455b5be206', 'volume_name': 'volume-8aef594f-ebc1-42fb-81d0-32455b5be206', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cb57c6-06de-493d-a110-a26e5216fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cb57c6-06de-493d-a110-a26e5216fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52edd416-48e2-4846-a823-57a149127346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:31 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Volume 8aef594f-ebc1-42fb-81d0-32455b5be206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aef594f-ebc1-42fb-81d0-32455b5be206', 'volume_size': 1} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ac55d3f-a8af-473b-9560-e41f7566599d,created_at=2026-07-07T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978664351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ac55d3f-a8af-473b-9560-e41f7566599d,host='devstack@QuobyteHD#QuobyteHD',id=8aef594f-ebc1-42fb-81d0-32455b5be206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf39ff19a5324e98a6af0747584f734b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:32Z,use_quota=True,user_id='030aef4f60a044c3b599bb9e8da45b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44726995-1e1a-4baa-ab9b-554d8e7af901),volume_type_id=44726995-1e1a-4baa-ab9b-554d8e7af901)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Creating volume 8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:31 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:31 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 1073741824 Jul 07 17:24:31 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-ee71e8ed-957c-4583-aa42-3e5664570736 req-1ed52f34-6482-4e25-b802-39e893874aee tempest-AttachVolumeNegativeTest-242484348 None] Terminate volume connection completed successfully. Jul 07 17:24:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-ee71e8ed-957c-4583-aa42-3e5664570736 req-1ed52f34-6482-4e25-b802-39e893874aee tempest-AttachVolumeNegativeTest-242484348 None] Deleting attachment 8111e6a1-7c7a-47cf-be8a-7f048daf7a86. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:32 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:24:32 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:32 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 1073741824" returned: 0 in 0.996s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:32 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 Jul 07 17:24:32 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:33 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.788s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:33 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206" returned: 0 in 0.834s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52edd416-48e2-4846-a823-57a149127346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aef594f-ebc1-42fb-81d0-32455b5be206', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b30de09-ab01-4bb4-a8ad-0e0ef32fe95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:33 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Volume volume-8aef594f-ebc1-42fb-81d0-32455b5be206 (8aef594f-ebc1-42fb-81d0-32455b5be206): created successfully Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b30de09-ab01-4bb4-a8ad-0e0ef32fe95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Flow 'volume_create_manager' (fde2909f-e0e8-4652-ad89-d0d8e67bf86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-19d3d112-dd7e-46ba-9664-b01264e6fdb1 tempest-GroupSnapshotsTest-449809021 None] Created volume successfully. Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b2360-da7a-4382-889f-6dbf1e481ffa]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:34 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 Jul 07 17:24:34 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] GroupSnapshot 51dfad8e-dfa9-4aa4-8a1a-ea4a9c700ef5: creating. Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Group snapshot 51dfad8e-dfa9-4aa4-8a1a-ea4a9c700ef5: creating. {{(pid=87251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:34 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5" returned: 0 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.531s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Creating offline snapshot e2a77e41-d2c1-4f0c-b632-d29182984bd7 of volume 8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977d2cf-b506-4c6e-bd35-605fb2210905]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ceaec93-4a68-45ca-b7c8-22884fa36726', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:24:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-7e93ae42-9ab9-4473-9979-f394daf66026 req-458cad49-f4b2-4d84-a627-5b87b5d8773d tempest-ServerActionsTestOtherA-1634437782 None] attachment_update completed successfully. Jul 07 17:24:35 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 Jul 07 17:24:35 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:36 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206" returned: 0 in 1.045s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:36 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 1G Jul 07 17:24:36 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:37 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 1G" returned: 0 in 1.357s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aef594f-ebc1-42fb-81d0-32455b5be206 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:37 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aef594f-ebc1-42fb-81d0-32455b5be206 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 Jul 07 17:24:37 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:38 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aef594f-ebc1-42fb-81d0-32455b5be206 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7" returned: 0 in 0.789s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:38 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:24:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:38 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 Jul 07 17:24:38 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:38 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:38 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=97,cinder:SELECT=113,cinder:INSERT=20 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:24:39 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=98,cinder:SELECT=99,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:24:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:39 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info Jul 07 17:24:39 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:39 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info" returned: 0 in 0.829s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:39 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:24:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:39 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info Jul 07 17:24:39 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:40 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.info" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.855s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:40 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2f8be055-727d-4bcf-907f-2b752e690616 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 51dfad8e-dfa9-4aa4-8a1a-ea4a9c700ef5: created successfully Jul 07 17:24:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 51dfad8e-dfa9-4aa4-8a1a-ea4a9c700ef5: deleting Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 51dfad8e-dfa9-4aa4-8a1a-ea4a9c700ef5: deleting {{(pid=87251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-8aef594f-ebc1-42fb-81d0-32455b5be206" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-8aef594f-ebc1-42fb-81d0-32455b5be206" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-e2a77e41-d2c1-4f0c-b632-d29182984bd7" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-e2a77e41-d2c1-4f0c-b632-d29182984bd7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Deleting offline snapshot e2a77e41-d2c1-4f0c-b632-d29182984bd7 of volume 8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] snapshot_file for this snap is: volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c200a3-7785-49b0-9e35-c311ddd358f4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:42 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 Jul 07 17:24:42 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:43 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7" returned: 0 in 1.047s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aef594f-ebc1-42fb-81d0-32455b5be206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a7af1-2ac3-4386-8cef-eebd0533f64d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:43 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 Jul 07 17:24:43 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:44 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-c39adc9c-d45a-4b02-89ef-6c854e0b07e2 tempest-ServerActionsTestOtherA-1634437782 None] Terminate volume connection completed successfully. Jul 07 17:24:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-c39adc9c-d45a-4b02-89ef-6c854e0b07e2 tempest-ServerActionsTestOtherA-1634437782 None] Deleting attachment 3ceaec93-4a68-45ca-b7c8-22884fa36726. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:24:44 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206" returned: 0 in 1.165s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:44 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 Jul 07 17:24:44 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:45 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7" returned: 0 in 1.108s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:45 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7 Jul 07 17:24:45 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:46 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206.e2a77e41-d2c1-4f0c-b632-d29182984bd7" returned: 0 in 0.842s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-e2a77e41-d2c1-4f0c-b632-d29182984bd7" released by "_delete_snapshot" :: held 4.350s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-8aef594f-ebc1-42fb-81d0-32455b5be206" released by "delete_snapshot" :: held 4.389s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:46 devstack cinder-volume[87251]: WARNING cinder.quota [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-916873018 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-916873018, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:24:46 devstack cinder-volume[87251]: WARNING cinder.quota [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-916873018 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-916873018, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:24:46 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['a99f9251-2a20-4fe9-9ec4-670c2644454b', 'c7cf4e5e-c5aa-4bcf-b307-66c7453acce4', '5859f55c-816d-480b-9869-6a2ed367cd1a', '8a4d3064-0aa3-4827-b8dd-c9cdafbf1189'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7a495f1c-11f1-467f-9752-f65567127e08 tempest-GroupSnapshotsTest-449809021 None] group_snapshot 51dfad8e-dfa9-4aa4-8a1a-ea4a9c700ef5: deleted successfully Jul 07 17:24:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4e4ed-2bc5-43cc-a42b-7862bc7d5aec]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:47 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 Jul 07 17:24:47 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:48 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c815743-acf5-4980-8f7b-673c6cbffee1', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:24:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-431e69dd-bb94-40e9-8156-7e5b214b35e7 req-806272cb-1c1f-48fc-b026-355b1e11f7a6 tempest-ServerActionsTestOtherA-1634437782 None] attachment_update completed successfully. Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "cinder-quobyte-8aef594f-ebc1-42fb-81d0-32455b5be206" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-8aef594f-ebc1-42fb-81d0-32455b5be206" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5807ee-92ad-48c5-a093-6350ae51fa8f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:48 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 Jul 07 17:24:48 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:49 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206" returned: 0 in 0.980s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:49 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206 Jul 07 17:24:49 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:50 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8aef594f-ebc1-42fb-81d0-32455b5be206" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Lock "cinder-quobyte-8aef594f-ebc1-42fb-81d0-32455b5be206" released by "delete_volume" :: held 1.940s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['6aa86f1c-4357-447c-8eb1-40f8d82ded02'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:50 devstack cinder-volume[87251]: WARNING cinder.quota [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-916873018 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-916873018, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Created reservations ['48c688bc-7cbb-4fbd-b0c2-a457b3036532', '25df1102-62fd-4277-b34f-2ca764f03304', 'ca6a5cd3-ab1c-4d75-a83e-ad9d56003fe2', '690d4baf-4596-40a2-808e-4b6c9cf68ef9'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:50 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:24:50 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:51 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.705s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:51 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-16d9107a-35b5-45c1-bd20-5089645b39a6 tempest-GroupSnapshotsTest-449809021 None] Delete group completed successfully. Jul 07 17:25:00 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=22 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:00 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=5 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c913372c-ee0e-4693-8565-aea22edfc4bf tempest-GroupsV314Test-1894567721 None] Group tempest-GroupsV314Test-Group-1132925185: creating Jul 07 17:25:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c913372c-ee0e-4693-8565-aea22edfc4bf tempest-GroupsV314Test-1894567721 None] Group tempest-GroupsV314Test-Group-1132925185: created successfully Jul 07 17:25:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c913372c-ee0e-4693-8565-aea22edfc4bf tempest-GroupsV314Test-1894567721 None] Create group completed successfully. Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Flow 'volume_create_manager' (b2e6a88e-5e8f-478e-ad5f-e227d38e09e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b707ee-1904-4b26-a34b-b52f08e4e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b707ee-1904-4b26-a34b-b52f08e4e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378871840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55d80517-d0a3-4daa-bb91-ca271d4f626b,host='devstack@QuobyteHD#QuobyteHD',id=badc3b65-79d9-4825-8176-86b77699d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162c7ed56d9e4103982d35258e1275b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:16Z,use_quota=True,user_id='f0390c0c34b74c03a26bfa990a39ea76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1742363d-2686-464e-b021-ddc748703d75),volume_type_id=1742363d-2686-464e-b021-ddc748703d75)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480d9ac8-149f-4887-8cc4-309c361784cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480d9ac8-149f-4887-8cc4-309c361784cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630560f5-1e56-4d11-a721-6ec91f16d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630560f5-1e56-4d11-a721-6ec91f16d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'badc3b65-79d9-4825-8176-86b77699d838', 'volume_name': 'volume-badc3b65-79d9-4825-8176-86b77699d838', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f3f66-6b9c-47fc-8302-9911b2b1e853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f3f66-6b9c-47fc-8302-9911b2b1e853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ba2739-64fb-4602-a762-fb26e058b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:16 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Volume badc3b65-79d9-4825-8176-86b77699d838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-badc3b65-79d9-4825-8176-86b77699d838', 'volume_size': 1} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55d80517-d0a3-4daa-bb91-ca271d4f626b,created_at=2026-07-07T15:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378871840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55d80517-d0a3-4daa-bb91-ca271d4f626b,host='devstack@QuobyteHD#QuobyteHD',id=badc3b65-79d9-4825-8176-86b77699d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162c7ed56d9e4103982d35258e1275b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:16Z,use_quota=True,user_id='f0390c0c34b74c03a26bfa990a39ea76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1742363d-2686-464e-b021-ddc748703d75),volume_type_id=1742363d-2686-464e-b021-ddc748703d75)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Creating volume badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:16 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:25:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:16 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 1073741824 Jul 07 17:25:16 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:17 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 1073741824" returned: 0 in 1.255s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:17 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:17 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:18 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 0.816s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ba2739-64fb-4602-a762-fb26e058b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badc3b65-79d9-4825-8176-86b77699d838', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebc86f0-ee9a-4d5c-ae82-5876828fa691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Volume volume-badc3b65-79d9-4825-8176-86b77699d838 (badc3b65-79d9-4825-8176-86b77699d838): created successfully Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebc86f0-ee9a-4d5c-ae82-5876828fa691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Flow 'volume_create_manager' (b2e6a88e-5e8f-478e-ad5f-e227d38e09e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-31c97cc4-1565-4d2a-a7e1-0801e065b26d tempest-GroupsV314Test-1894567721 None] Created volume successfully. Jul 07 17:25:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-2a45539b-399f-4382-a9e6-86e61f4e6e4d req-1bd95766-9aa5-4be2-b208-9179f04ed07f tempest-ServerActionsTestOtherA-1634437782 None] Terminate volume connection completed successfully. Jul 07 17:25:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-2a45539b-399f-4382-a9e6-86e61f4e6e4d req-1bd95766-9aa5-4be2-b208-9179f04ed07f tempest-ServerActionsTestOtherA-1634437782 None] Deleting attachment 0c815743-acf5-4980-8f7b-673c6cbffee1. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:25:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:21 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Cloning volume badc3b65-79d9-4825-8176-86b77699d838 to volume 464e205c-26ef-41e2-b203-6a0d98a5e5c8 Jul 07 17:25:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Creating offline snapshot e99fa614-58ad-4b09-987b-4f082a1d4df2 of volume badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:25:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1869ff9-3064-4de7-b256-60da533d9117]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:21 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:21 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:22 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 0.891s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:22 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 1G Jul 07 17:25:22 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:22 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 1G" returned: 0 in 0.895s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-badc3b65-79d9-4825-8176-86b77699d838 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:23 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-badc3b65-79d9-4825-8176-86b77699d838 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 Jul 07 17:25:23 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:23 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-badc3b65-79d9-4825-8176-86b77699d838 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2" returned: 0 in 0.769s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:23 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:25:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:23 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 Jul 07 17:25:23 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:24 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2" returned: 0 in 0.697s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:24 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info Jul 07 17:25:24 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:25 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info" returned: 0 in 0.854s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:25 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:25:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:25 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info Jul 07 17:25:25 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:26 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.info" returned: 0 in 0.832s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Acquiring lock "cinder-quobyte-464e205c-26ef-41e2-b203-6a0d98a5e5c8" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-464e205c-26ef-41e2-b203-6a0d98a5e5c8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] snapshot: e99fa614-58ad-4b09-987b-4f082a1d4df2, volume: 464e205c-26ef-41e2-b203-6a0d98a5e5c8, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa68f2a-a82f-47f7-bd80-740e671fd434]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:26 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 Jul 07 17:25:26 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:27 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2" returned: 0 in 0.801s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-badc3b65-79d9-4825-8176-86b77699d838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[064fe9a4-73e1-4275-933f-1e0b3f8b2705]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:27 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:27 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:27 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 0.774s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:25:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:27 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 Jul 07 17:25:27 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:32 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:25:32 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:33 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8" returned: 0 in 5.287s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[94937487-0cfd-453e-bd8b-a6500d980fbf]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:33 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:33 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:33 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.877s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:25:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:25:34 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 1.176s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:25:34 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Converted 1024.00 MB image at 193.66 MB/s Jul 07 17:25:34 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:34 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 Jul 07 17:25:34 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Flow 'volume_create_manager' (1c81dfd4-c203-4891-bbea-456cb4ba4dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52773282-87c4-4d3d-99de-159b76fda3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52773282-87c4-4d3d-99de-159b76fda3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-328342353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ecf577-7665-4cdc-b34d-f83275d4ad17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d32ea08c43342bf9ebf0309305ac64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:35Z,use_quota=True,user_id='39e40ffe59834029ba1d438cd05b3a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedb4977-d47f-444a-b71b-c7c726a249be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedb4977-d47f-444a-b71b-c7c726a249be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a4c7f6-5c02-42ed-b04d-65609b5441c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a4c7f6-5c02-42ed-b04d-65609b5441c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ecf577-7665-4cdc-b34d-f83275d4ad17', 'volume_name': 'volume-06ecf577-7665-4cdc-b34d-f83275d4ad17', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ae384d-f416-46a6-a38a-134028f4b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ae384d-f416-46a6-a38a-134028f4b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0633d137-3ed4-4461-ba4b-4d2481d61267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:34 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Volume 06ecf577-7665-4cdc-b34d-f83275d4ad17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ecf577-7665-4cdc-b34d-f83275d4ad17', 'volume_size': 1} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "cinder-629a4b3f-d41a-4d49-8869-f453bb83a1d5-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Lock "cinder-629a4b3f-d41a-4d49-8869-f453bb83a1d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "cinder-quobyte-629a4b3f-d41a-4d49-8869-f453bb83a1d5" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Lock "cinder-quobyte-629a4b3f-d41a-4d49-8869-f453bb83a1d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[56428253-d2b3-457d-b07d-33b394386683]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:35 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 Jul 07 17:25:35 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:35 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8" returned: 0 in 0.870s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-464e205c-26ef-41e2-b203-6a0d98a5e5c8" released by "_copy_volume_from_snapshot" :: held 9.007s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Acquiring lock "cinder-quobyte-e99fa614-58ad-4b09-987b-4f082a1d4df2" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-e99fa614-58ad-4b09-987b-4f082a1d4df2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Deleting offline snapshot e99fa614-58ad-4b09-987b-4f082a1d4df2 of volume badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] snapshot_file for this snap is: volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c6c561-b63f-47e2-9a67-512916869939]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:35 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 Jul 07 17:25:35 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:35 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5" returned: 0 in 0.863s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:35 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5 Jul 07 17:25:35 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:36 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2" returned: 0 in 0.823s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-badc3b65-79d9-4825-8176-86b77699d838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbce76-c75f-4203-9a11-c5e8591ecef9]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:36 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:36 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:36 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-629a4b3f-d41a-4d49-8869-f453bb83a1d5" returned: 0 in 0.650s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Lock "cinder-quobyte-629a4b3f-d41a-4d49-8869-f453bb83a1d5" released by "delete_volume" :: held 1.592s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Created reservations ['ff90bacd-4594-4c55-8482-b94d3275ded5', 'bec80060-d828-479a-876c-43fa962958f0', 'aa954f7c-a7da-49cd-b5fd-da71a97c17a7', 'af155374-24c6-47c8-9630-d2f8cfad0d12'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:36 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:25:36 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:36 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 0.820s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:37 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 Jul 07 17:25:37 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:37 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Flow 'volume_create_manager' (08c4c284-3cd2-45c8-b7af-44edc52afdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e81f4e-fcb4-4abc-a4e0-0decd4ce785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.830s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Deleted volume successfully. Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e81f4e-fcb4-4abc-a4e0-0decd4ce785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1905751951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25048773-11d8-4f4a-9c27-3d07c89305d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362643cf32954bc3ac25fc3ac59a817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:37Z,use_quota=True,user_id='741899cff3ba48939c1ebc8adc60efa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236c1882-3d0d-417e-bf3e-754125807948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236c1882-3d0d-417e-bf3e-754125807948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2904fb19-c4b8-4f55-b910-0d3e67640510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2904fb19-c4b8-4f55-b910-0d3e67640510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25048773-11d8-4f4a-9c27-3d07c89305d2', 'volume_name': 'volume-25048773-11d8-4f4a-9c27-3d07c89305d2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c383d161-b3f5-437d-bb56-9e022e59454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c383d161-b3f5-437d-bb56-9e022e59454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbcf455-9736-47f1-b23f-e596ced10b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Volume 25048773-11d8-4f4a-9c27-3d07c89305d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25048773-11d8-4f4a-9c27-3d07c89305d2', 'volume_size': 1} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eaf5c329-aca4-4652-ab17-30cc275f723e tempest-ServerActionsTestOtherA-1634437782 None] Lock "cinder-629a4b3f-d41a-4d49-8869-f453bb83a1d5-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:37 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2" returned: 0 in 0.942s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:37 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2 Jul 07 17:25:37 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:38 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838.e99fa614-58ad-4b09-987b-4f082a1d4df2" returned: 0 in 0.660s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-e99fa614-58ad-4b09-987b-4f082a1d4df2" released by "_delete_snapshot" :: held 3.345s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.552s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.924s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-328342353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ecf577-7665-4cdc-b34d-f83275d4ad17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d32ea08c43342bf9ebf0309305ac64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:35Z,use_quota=True,user_id='39e40ffe59834029ba1d438cd05b3a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Creating volume 06ecf577-7665-4cdc-b34d-f83275d4ad17 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:38 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:25:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:38 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 1073741824 Jul 07 17:25:38 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:38 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-867fb688-c643-4ecc-bfe7-f3197e32fd51 tempest-GroupsV314Test-1894567721 None] Create group from source-group-55d80517-d0a3-4daa-bb91-ca271d4f626b completed successfully. Jul 07 17:25:39 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 1073741824" returned: 0 in 1.118s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:39 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 Jul 07 17:25:39 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Acquiring lock "cinder-quobyte-464e205c-26ef-41e2-b203-6a0d98a5e5c8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-464e205c-26ef-41e2-b203-6a0d98a5e5c8" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d7f52-72f0-4884-b4a8-0be6ded72178]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:40 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 Jul 07 17:25:40 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:40 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17" returned: 0 in 0.899s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.144s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1905751951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25048773-11d8-4f4a-9c27-3d07c89305d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362643cf32954bc3ac25fc3ac59a817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:37Z,use_quota=True,user_id='741899cff3ba48939c1ebc8adc60efa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Creating volume 25048773-11d8-4f4a-9c27-3d07c89305d2 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:40 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0633d137-3ed4-4461-ba4b-4d2481d61267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ecf577-7665-4cdc-b34d-f83275d4ad17', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b18a0ce-7757-491c-944a-bd8b90a3d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:40 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 1073741824 Jul 07 17:25:40 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:40 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Volume volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 (06ecf577-7665-4cdc-b34d-f83275d4ad17): created successfully Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b18a0ce-7757-491c-944a-bd8b90a3d197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Flow 'volume_create_manager' (1c81dfd4-c203-4891-bbea-456cb4ba4dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:40 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-12e317b0-cd62-4dc0-8736-1196773f7e35 tempest-AttachVolumeTestJSON-1764762157 None] Created volume successfully. Jul 07 17:25:41 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8" returned: 0 in 1.093s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:41 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8 Jul 07 17:25:41 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:41 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 1073741824" returned: 0 in 1.125s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:41 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 Jul 07 17:25:41 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:42 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-464e205c-26ef-41e2-b203-6a0d98a5e5c8" returned: 0 in 0.736s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-464e205c-26ef-41e2-b203-6a0d98a5e5c8" released by "delete_volume" :: held 1.892s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Created reservations ['1ea99ec4-76ef-49bb-81b3-1e5fc7fca6d7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:42 devstack cinder-volume[87251]: WARNING cinder.quota [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1241590278 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1241590278, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:42 devstack cinder-volume[87251]: WARNING cinder.quota [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1241590278 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1241590278, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Created reservations ['eb18f1e4-e7e7-4e41-8dc4-e518bd8fee03', '0314d626-56f0-48cb-a9d5-440869a8a329', 'd1e8dd6b-ddba-4244-89eb-72ec7861c07b', 'ef3e4364-061b-40d2-b51f-fda5788d25eb'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:42 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2" returned: 0 in 0.659s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:42 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:25:42 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbcf455-9736-47f1-b23f-e596ced10b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25048773-11d8-4f4a-9c27-3d07c89305d2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3fc2a0-7963-4149-81f7-a206ed89bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Volume volume-25048773-11d8-4f4a-9c27-3d07c89305d2 (25048773-11d8-4f4a-9c27-3d07c89305d2): created successfully Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3fc2a0-7963-4149-81f7-a206ed89bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Flow 'volume_create_manager' (08c4c284-3cd2-45c8-b7af-44edc52afdee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-25b21270-b43a-4036-8de2-e6c679c1b8b8 tempest-AttachVolumeNegativeTest-242484348 None] Created volume successfully. Jul 07 17:25:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Acquiring lock "cinder-quobyte-badc3b65-79d9-4825-8176-86b77699d838" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-badc3b65-79d9-4825-8176-86b77699d838" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:43 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.679s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5acf37ae-c6f2-440d-a8b1-7835a433d1ad tempest-GroupsV314Test-1894567721 None] Delete group completed successfully. Jul 07 17:25:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a0f4b-183d-4efd-8d86-14411087ea64]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:43 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:43 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 0.874s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:44 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838 Jul 07 17:25:44 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f093a10-5fbd-4897-8be7-94ced1edbfd6]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:44 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 Jul 07 17:25:44 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:44 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-badc3b65-79d9-4825-8176-86b77699d838" returned: 0 in 0.731s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Lock "cinder-quobyte-badc3b65-79d9-4825-8176-86b77699d838" released by "delete_volume" :: held 1.697s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Created reservations ['7a1b68a3-2900-4fb9-93b2-8ea00403d7fb'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Created reservations ['4787f1af-893d-4838-95d3-0d0048766b62', '01a519cc-abdc-4407-9f30-50075cf13445', '91cbebf2-8bf2-409d-9b54-0feb7b1509e4', '88a55e1b-558f-4c4e-8a7e-de48e3ae4094'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:45 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17" returned: 0 in 0.876s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.895s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-06ecf577-7665-4cdc-b34d-f83275d4ad17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc013556-3478-45a2-a6ba-7ed8659d3408', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:25:45 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:25:45 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:45 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-04377a4a-a9d0-4e32-bcdb-039d964f7d72 req-1650bab4-490d-48c4-acaf-b6db8a1ba4b1 tempest-AttachVolumeTestJSON-1764762157 None] attachment_update completed successfully. Jul 07 17:25:46 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.949s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:46 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6da40223-7733-4e6f-89e2-ceefe0b7e889 tempest-GroupsV314Test-1894567721 None] Delete group completed successfully. Jul 07 17:25:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34f1c66-dd4a-45fb-84b3-24508f9809de]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:46 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 Jul 07 17:25:46 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:47 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2" returned: 0 in 0.909s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-25048773-11d8-4f4a-9c27-3d07c89305d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fab09d21-c22f-43d5-b594-01f93af43cc8', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:25:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-702a24e3-fbd0-4bb8-8a2c-1f1d719f7153 req-0a0516e5-500b-4f30-b83c-33bbffa4626f tempest-AttachVolumeNegativeTest-242484348 None] attachment_update completed successfully. Jul 07 17:25:54 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-5cfc6424-e95d-40c1-8642-90d79b3035b7 req-48367075-5255-4cac-a8a5-fc4bb1b3c6dd tempest-AttachVolumeNegativeTest-242484348 None] Terminate volume connection completed successfully. Jul 07 17:25:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-5cfc6424-e95d-40c1-8642-90d79b3035b7 req-48367075-5255-4cac-a8a5-fc4bb1b3c6dd tempest-AttachVolumeNegativeTest-242484348 None] Deleting attachment fab09d21-c22f-43d5-b594-01f93af43cc8. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:26:04 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=40,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:26:04 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=38,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:26:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "cinder-25048773-11d8-4f4a-9c27-3d07c89305d2-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-25048773-11d8-4f4a-9c27-3d07c89305d2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "cinder-quobyte-25048773-11d8-4f4a-9c27-3d07c89305d2" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-quobyte-25048773-11d8-4f4a-9c27-3d07c89305d2" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0056b15-6b55-4b00-88de-7dcb9c5fce78]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:06 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 Jul 07 17:26:06 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:07 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2" returned: 0 in 1.241s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:07 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2 Jul 07 17:26:07 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:08 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-25048773-11d8-4f4a-9c27-3d07c89305d2" returned: 0 in 1.056s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-quobyte-25048773-11d8-4f4a-9c27-3d07c89305d2" released by "delete_volume" :: held 2.412s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Created reservations ['ea2fc0c8-5e47-4020-9ff5-03a26ce58479', 'ad58941b-9f3d-4f54-a3bf-4fc1f32f1031', '52b609bf-8150-4b38-8cf3-66bd0bf116c9', 'f39de717-a3cf-453a-824a-ff56e226a4a4'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:08 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:08 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Flow 'volume_create_manager' (0e0786a2-60d2-4f53-a6ac-d3e04fa808f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78cae9d1-75f7-4929-87b7-8875704bea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78cae9d1-75f7-4929-87b7-8875704bea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-12596397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d856f89-416c-45d3-b2da-45eef659caa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ede421557462dba78e21439c9f3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:09Z,use_quota=True,user_id='53902b81cbb74cbf922a2c9bcfe765d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7e94ec-439c-444f-8386-979e84e4de64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7e94ec-439c-444f-8386-979e84e4de64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa365218-0282-4d9e-b3d5-13258bab9660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa365218-0282-4d9e-b3d5-13258bab9660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d856f89-416c-45d3-b2da-45eef659caa4', 'volume_name': 'volume-7d856f89-416c-45d3-b2da-45eef659caa4', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5531e7-7427-48ce-beaf-c4f1e33cc732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5531e7-7427-48ce-beaf-c4f1e33cc732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c212c512-7b07-4a4d-b36f-f2af6cba14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Volume 7d856f89-416c-45d3-b2da-45eef659caa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d856f89-416c-45d3-b2da-45eef659caa4', 'volume_size': 1} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-12596397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d856f89-416c-45d3-b2da-45eef659caa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ede421557462dba78e21439c9f3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:09Z,use_quota=True,user_id='53902b81cbb74cbf922a2c9bcfe765d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Creating volume 7d856f89-416c-45d3-b2da-45eef659caa4 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:09 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 1073741824 Jul 07 17:26:09 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "cinder-ad865b85-0de7-41bc-9cc4-73079565b23a-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:09 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.420s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-ad865b85-0de7-41bc-9cc4-73079565b23a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Deleted volume successfully. Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ddae3de3-c68e-4954-8c68-1ab79ee4be9d tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-25048773-11d8-4f4a-9c27-3d07c89305d2-delete_volume" released by "delete_volume" :: held 4.146s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "cinder-quobyte-ad865b85-0de7-41bc-9cc4-73079565b23a" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-quobyte-ad865b85-0de7-41bc-9cc4-73079565b23a" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908ecba-1360-4b1e-8c12-3d46dbe6fb4a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:10 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a Jul 07 17:26:10 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:10 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 1073741824" returned: 0 in 1.463s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:10 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 Jul 07 17:26:10 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a" returned: 0 in 1.021s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:11 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a Jul 07 17:26:11 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4" returned: 0 in 0.855s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] <== create_volume: return (2395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c212c512-7b07-4a4d-b36f-f2af6cba14de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d856f89-416c-45d3-b2da-45eef659caa4', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629eb425-fb47-4195-be5f-ae37fbfba3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Volume volume-7d856f89-416c-45d3-b2da-45eef659caa4 (7d856f89-416c-45d3-b2da-45eef659caa4): created successfully Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629eb425-fb47-4195-be5f-ae37fbfba3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Flow 'volume_create_manager' (0e0786a2-60d2-4f53-a6ac-d3e04fa808f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b476b70f-a0b6-40ca-8e8c-023044558fcf tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Created volume successfully. Jul 07 17:26:11 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ad865b85-0de7-41bc-9cc4-73079565b23a" returned: 0 in 0.821s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-quobyte-ad865b85-0de7-41bc-9cc4-73079565b23a" released by "delete_volume" :: held 1.902s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Created reservations ['298955c3-36e5-4d85-851e-f45176d0b113', 'c226775c-f3b4-470f-8816-705b2ffc413e', '0e18b863-0989-44f4-b0c9-0551554c1c08', 'cf1a3f48-f126-4da3-93a6-b32d2e5da232'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:12 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:12 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "cinder-8bf821bf-6702-4fa7-a244-e654beedc251-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-8bf821bf-6702-4fa7-a244-e654beedc251-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "cinder-quobyte-8bf821bf-6702-4fa7-a244-e654beedc251" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-quobyte-8bf821bf-6702-4fa7-a244-e654beedc251" acquired by "delete_volume" :: waited 0.040s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1da4b7-b9bb-4093-bd1c-334ee68f6770]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:13 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 Jul 07 17:26:13 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:13 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.244s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:13 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Deleted volume successfully. Jul 07 17:26:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3e91fb89-0015-49b4-9c3c-d43d8d5eb441 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-ad865b85-0de7-41bc-9cc4-73079565b23a-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Acquiring lock "cinder-7d856f89-416c-45d3-b2da-45eef659caa4-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "cinder-7d856f89-416c-45d3-b2da-45eef659caa4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Acquiring lock "cinder-quobyte-7d856f89-416c-45d3-b2da-45eef659caa4" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "cinder-quobyte-7d856f89-416c-45d3-b2da-45eef659caa4" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f8bc8b-7f8e-4154-bca9-8cb312e56eef]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:14 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 Jul 07 17:26:14 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:14 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251" returned: 0 in 1.688s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:14 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251 Jul 07 17:26:14 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:15 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4" returned: 0 in 1.205s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:15 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4 Jul 07 17:26:15 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:15 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8bf821bf-6702-4fa7-a244-e654beedc251" returned: 0 in 0.977s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-quobyte-8bf821bf-6702-4fa7-a244-e654beedc251" released by "delete_volume" :: held 2.754s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Created reservations ['2255ce1f-b3be-46b0-a6d8-e332bc5c3e0a', 'f0e80f6d-6597-4109-a683-e869df77b39c', 'c9b992e8-1aaf-4c73-9b00-98a076ebc1fc', 'f18f98bf-660f-4536-b058-0c074137aa58'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:15 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:15 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:16 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7d856f89-416c-45d3-b2da-45eef659caa4" returned: 0 in 0.695s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "cinder-quobyte-7d856f89-416c-45d3-b2da-45eef659caa4" released by "delete_volume" :: held 1.956s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Created reservations ['8fd19cf5-b93c-4699-a518-a816f749c69f', '023d3bd7-74eb-43ac-b50e-c3f5cec4c6f5', '581d9090-607e-482f-98f8-31fb23e15482', 'b57d1074-9a04-43eb-b3ee-49d490b7f187'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:16 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:16 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:16 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.937s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Deleted volume successfully. Jul 07 17:26:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-eea6e7cc-63cb-42a5-a7a8-471ff1c2f5d9 tempest-AttachVolumeNegativeTest-242484348 None] Lock "cinder-8bf821bf-6702-4fa7-a244-e654beedc251-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:17 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.953s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:17 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Deleted volume successfully. Jul 07 17:26:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-83f11d51-b7dd-4b88-ba93-b7064909107c tempest-VolumeQuotasNegativeTestJSON-1240429178 None] Lock "cinder-7d856f89-416c-45d3-b2da-45eef659caa4-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Flow 'volume_create_manager' (0a631acf-9804-40eb-afac-2aaf2822cb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dcde0f-a53a-4865-8af9-1f5c94fbbec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dcde0f-a53a-4865-8af9-1f5c94fbbec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1970772719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a742a8-e762-4ab0-b4bf-f7c50389ba54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb87b7776eb4ac48ea712cead546a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:25Z,use_quota=True,user_id='f8c3d36453834019861b78e8a57ae8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af33b2f-0a77-4f6a-b64e-89d146004a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af33b2f-0a77-4f6a-b64e-89d146004a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669b0204-7f30-4adc-bff9-a969b79f758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669b0204-7f30-4adc-bff9-a969b79f758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a742a8-e762-4ab0-b4bf-f7c50389ba54', 'volume_name': 'volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d0dab1-4507-4a75-b722-918df71ac8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d0dab1-4507-4a75-b722-918df71ac8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2100afe-7475-4d40-ab9c-879648caac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:25 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Volume 80a742a8-e762-4ab0-b4bf-f7c50389ba54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54', 'volume_size': 1} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1970772719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a742a8-e762-4ab0-b4bf-f7c50389ba54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb87b7776eb4ac48ea712cead546a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:25Z,use_quota=True,user_id='f8c3d36453834019861b78e8a57ae8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Creating volume 80a742a8-e762-4ab0-b4bf-f7c50389ba54 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:25 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:25 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 1073741824 Jul 07 17:26:25 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Flow 'volume_create_manager' (4f5e6ba5-b2a0-4fec-b942-884bc1924c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1c487f-4094-4a4b-b44c-b38272038079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1c487f-4094-4a4b-b44c-b38272038079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1276633760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b2c255-0ee9-4e57-9e30-c5861844d34e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ac486dfa4334173968d888227b2d802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:26Z,use_quota=True,user_id='7312b739ae22457d88085cc1eebb6f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166e939a-e02b-45fe-93a6-1b6fbf1dd08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166e939a-e02b-45fe-93a6-1b6fbf1dd08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745b2740-b18e-4cf6-b283-fd70b70ada8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745b2740-b18e-4cf6-b283-fd70b70ada8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b2c255-0ee9-4e57-9e30-c5861844d34e', 'volume_name': 'volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9f03d4-4b30-4ff5-aaa1-dcae9197afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9f03d4-4b30-4ff5-aaa1-dcae9197afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8db06bb-970e-4122-a73d-fbb39fb115c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Volume b0b2c255-0ee9-4e57-9e30-c5861844d34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e', 'volume_size': 1} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:26 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 1073741824" returned: 0 in 1.180s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:26 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 Jul 07 17:26:26 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:27 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54" returned: 0 in 0.951s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1276633760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b2c255-0ee9-4e57-9e30-c5861844d34e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ac486dfa4334173968d888227b2d802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:26Z,use_quota=True,user_id='7312b739ae22457d88085cc1eebb6f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Creating volume b0b2c255-0ee9-4e57-9e30-c5861844d34e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:27 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2100afe-7475-4d40-ab9c-879648caac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:27 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e 1073741824 Jul 07 17:26:27 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf84d7-2363-4653-8229-daaf2f9a1928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:27 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Volume volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 (80a742a8-e762-4ab0-b4bf-f7c50389ba54): created successfully Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf84d7-2363-4653-8229-daaf2f9a1928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Flow 'volume_create_manager' (0a631acf-9804-40eb-afac-2aaf2822cb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9ded3e53-3830-402c-85bc-80ecf1a5e962 tempest-VolumesServicesTestJSON-1870888493 None] Created volume successfully. Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Acquiring lock "cinder-80a742a8-e762-4ab0-b4bf-f7c50389ba54-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:28 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Lock "cinder-80a742a8-e762-4ab0-b4bf-f7c50389ba54-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e 1073741824" returned: 0 in 1.159s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Acquiring lock "cinder-quobyte-80a742a8-e762-4ab0-b4bf-f7c50389ba54" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Lock "cinder-quobyte-80a742a8-e762-4ab0-b4bf-f7c50389ba54" acquired by "delete_volume" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a96e2d1-a3df-4699-993c-98529795c15c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:28 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e Jul 07 17:26:28 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:29 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 Jul 07 17:26:29 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:29 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e" returned: 0 in 0.947s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:29 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8db06bb-970e-4122-a73d-fbb39fb115c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd4450-7ef2-4e51-b712-c54c01d417be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54" returned: 0 in 0.949s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:29 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54 Jul 07 17:26:29 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:29 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Volume volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e (b0b2c255-0ee9-4e57-9e30-c5861844d34e): created successfully Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd4450-7ef2-4e51-b712-c54c01d417be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Flow 'volume_create_manager' (4f5e6ba5-b2a0-4fec-b942-884bc1924c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-59d8fa3a-4164-4df5-9e4f-6b016bac935e req-32418d0c-d25e-4698-b202-4e893318b11f tempest-VolumesGetTestJSON-2070304049 None] Created volume successfully. Jul 07 17:26:30 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-80a742a8-e762-4ab0-b4bf-f7c50389ba54" returned: 0 in 0.868s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Lock "cinder-quobyte-80a742a8-e762-4ab0-b4bf-f7c50389ba54" released by "delete_volume" :: held 1.904s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Created reservations ['2e2c567a-9377-49a9-b6ef-3b86b364ee56', '5863a88a-d522-4995-a0be-f551e315f0eb', 'b944a54b-5ceb-41fd-8efd-86128c6222ae', 'b2445f01-61da-459b-9b54-d6527505fa0d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:30 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:30 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Acquiring lock "cinder-b0b2c255-0ee9-4e57-9e30-c5861844d34e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Lock "cinder-b0b2c255-0ee9-4e57-9e30-c5861844d34e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Acquiring lock "cinder-quobyte-b0b2c255-0ee9-4e57-9e30-c5861844d34e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Lock "cinder-quobyte-b0b2c255-0ee9-4e57-9e30-c5861844d34e" acquired by "delete_volume" :: waited 0.051s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:31 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e50ba7-dfe9-4ac9-9e75-9949df0fa7cb]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:31 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e Jul 07 17:26:31 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-fd2c3edd-4805-4bef-87ca-bb3acc933b07 req-94d2e11d-42c0-44d5-97e8-ef64a62e5bf6 tempest-AttachVolumeTestJSON-1764762157 None] Terminate volume connection completed successfully. Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-fd2c3edd-4805-4bef-87ca-bb3acc933b07 req-94d2e11d-42c0-44d5-97e8-ef64a62e5bf6 tempest-AttachVolumeTestJSON-1764762157 None] Deleting attachment cc013556-3478-45a2-a6ba-7ed8659d3408. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:26:32 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.528s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Deleted volume successfully. Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8068307f-289b-4ea9-9950-e04bb7641459 tempest-VolumesServicesTestJSON-1870888493 None] Lock "cinder-80a742a8-e762-4ab0-b4bf-f7c50389ba54-delete_volume" released by "delete_volume" :: held 3.796s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:32 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e" returned: 0 in 1.474s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:32 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:32 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:32 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e Jul 07 17:26:32 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:34 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.398s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:26:34 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b0b2c255-0ee9-4e57-9e30-c5861844d34e" returned: 0 in 1.606s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Lock "cinder-quobyte-b0b2c255-0ee9-4e57-9e30-c5861844d34e" released by "delete_volume" :: held 3.187s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.quota [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Created reservations ['5373517f-d408-4638-8d96-cd2442721dca', 'bc5580a5-343a-430a-8b9a-d8cea5cb0d1c', '3dd3b19a-e959-4129-86b6-fccf6f084abc', 'd0c6ab3b-64be-4ae1-b8d7-a43b1c9fc48a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:34 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:26:34 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:36 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.432s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:36 devstack cinder-volume[87251]: DEBUG cinder.manager [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:36 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Deleted volume successfully. Jul 07 17:26:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-d424e2e3-4d15-4913-b35b-8cd38c054a38 req-131c0515-ada3-4884-87d7-6919778590db tempest-VolumesGetTestJSON-2070304049 None] Lock "cinder-b0b2c255-0ee9-4e57-9e30-c5861844d34e-delete_volume" released by "delete_volume" :: held 5.226s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:41 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Flow 'volume_create_manager' (c51ebe65-039d-47d3-8480-3f46edc1067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68e20dc-8b02-4b54-8b73-f733049dfcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68e20dc-8b02-4b54-8b73-f733049dfcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1197707204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da600d1f-d555-4893-9282-e3384ccd4ca8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ccb815f4e4d22a2c49f47976d7676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:42Z,use_quota=True,user_id='7717628fb8e4470985108c084b6345c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9eab46-3ca6-4e6e-973b-5dfe94f7cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9eab46-3ca6-4e6e-973b-5dfe94f7cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4269dd6f-afdb-44b4-8589-6eebcd15cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4269dd6f-afdb-44b4-8589-6eebcd15cc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da600d1f-d555-4893-9282-e3384ccd4ca8', 'volume_name': 'volume-da600d1f-d555-4893-9282-e3384ccd4ca8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e59a4-ef6b-48ca-b5ce-6dc026f3fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e59a4-ef6b-48ca-b5ce-6dc026f3fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ec7aa1-21be-4bef-90a3-68dc807f1bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Volume da600d1f-d555-4893-9282-e3384ccd4ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da600d1f-d555-4893-9282-e3384ccd4ca8', 'volume_size': 1} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1197707204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da600d1f-d555-4893-9282-e3384ccd4ca8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ccb815f4e4d22a2c49f47976d7676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:42Z,use_quota=True,user_id='7717628fb8e4470985108c084b6345c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Creating volume da600d1f-d555-4893-9282-e3384ccd4ca8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:42 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:42 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 1073741824 Jul 07 17:26:42 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Flow 'volume_create_manager' (5b7acbde-c604-4d0a-ac36-4551a1e4357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec710e09-d32a-445c-b9ee-a76422ec3549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec710e09-d32a-445c-b9ee-a76422ec3549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-948409891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62955e7-fdd5-4df5-b245-4d304f78e7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b54ca93ba4aa88443572573e47eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:42Z,use_quota=True,user_id='c866ed014cfc4ad18ea6b66d48c7a62a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213d6c96-d6ab-4cf2-bd65-791963873ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213d6c96-d6ab-4cf2-bd65-791963873ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07c5301-1113-4354-93b6-663e05b6a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07c5301-1113-4354-93b6-663e05b6a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62955e7-fdd5-4df5-b245-4d304f78e7e8', 'volume_name': 'volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97276985-4588-4fbe-b1cc-3bcc047c74cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97276985-4588-4fbe-b1cc-3bcc047c74cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322c78b7-7893-4035-8f4e-27aa1249a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Volume e62955e7-fdd5-4df5-b245-4d304f78e7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8', 'volume_size': 1} Jul 07 17:26:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:43 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 1073741824" returned: 0 in 0.982s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:43 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 Jul 07 17:26:43 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:44 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8" returned: 0 in 0.848s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-948409891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62955e7-fdd5-4df5-b245-4d304f78e7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b54ca93ba4aa88443572573e47eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:42Z,use_quota=True,user_id='c866ed014cfc4ad18ea6b66d48c7a62a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Creating volume e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:44 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:44 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 1073741824 Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ec7aa1-21be-4bef-90a3-68dc807f1bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da600d1f-d555-4893-9282-e3384ccd4ca8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:44 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c186d66-8a40-46ea-bee1-60f6ef108fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Volume volume-da600d1f-d555-4893-9282-e3384ccd4ca8 (da600d1f-d555-4893-9282-e3384ccd4ca8): created successfully Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c186d66-8a40-46ea-bee1-60f6ef108fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Flow 'volume_create_manager' (c51ebe65-039d-47d3-8480-3f46edc1067a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:44 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d0c8a9ae-db8c-42a8-afbd-90492dc570f2 tempest-VolumesTestJSON-1533175491 None] Created volume successfully. Jul 07 17:26:44 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 1073741824" returned: 0 in 0.856s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:45 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 Jul 07 17:26:45 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:46 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8" returned: 0 in 1.101s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322c78b7-7893-4035-8f4e-27aa1249a06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee5f58f-fd42-4cba-bfbe-246188a6afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Volume volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 (e62955e7-fdd5-4df5-b245-4d304f78e7e8): created successfully Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee5f58f-fd42-4cba-bfbe-246188a6afd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Flow 'volume_create_manager' (5b7acbde-c604-4d0a-ac36-4551a1e4357b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ec2d6a3d-db5d-4725-a143-223b740048e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Created volume successfully. Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Flow 'volume_create_manager' (37631a37-59a6-409b-805c-98472a11fefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e1a820-f10c-484c-9c15-5620106ded3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e1a820-f10c-484c-9c15-5620106ded3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869673524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1340a2cb-699c-41d8-8535-7b9c674e8909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ccb815f4e4d22a2c49f47976d7676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:46Z,use_quota=True,user_id='7717628fb8e4470985108c084b6345c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f6191e-5722-4aa0-ba7b-ca39230307dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f6191e-5722-4aa0-ba7b-ca39230307dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8674c20-5b1a-4666-8528-ea8ba32cac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8674c20-5b1a-4666-8528-ea8ba32cac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1340a2cb-699c-41d8-8535-7b9c674e8909', 'volume_name': 'volume-1340a2cb-699c-41d8-8535-7b9c674e8909', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8a530f-175e-4352-9be4-2af9fb14f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8a530f-175e-4352-9be4-2af9fb14f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03331ba3-7bf5-4a92-930e-5bafad0f1708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Volume 1340a2cb-699c-41d8-8535-7b9c674e8909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1340a2cb-699c-41d8-8535-7b9c674e8909', 'volume_size': 1} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869673524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1340a2cb-699c-41d8-8535-7b9c674e8909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ccb815f4e4d22a2c49f47976d7676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:46Z,use_quota=True,user_id='7717628fb8e4470985108c084b6345c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Creating volume 1340a2cb-699c-41d8-8535-7b9c674e8909 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:46 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:46 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 1073741824 Jul 07 17:26:46 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:47 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 1073741824" returned: 0 in 1.397s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:47 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:47 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 Jul 07 17:26:47 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Flow 'volume_create_manager' (59c05eb0-5d9a-4e6f-8fc9-0cbe4b20aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a754cf-1633-4637-943e-daae560f35d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a754cf-1633-4637-943e-daae560f35d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-463314870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d64e133-9feb-46c1-a838-736a2087d340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0023d9aa4b8f4780a87cd7cbf1adc8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:48Z,use_quota=True,user_id='c659848e56a947c695eb25f7c2c4ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2062f1b-de66-4553-b98a-d78f0430f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2062f1b-de66-4553-b98a-d78f0430f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4910b3d-7ce0-4b6b-93c7-d76eb155ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4910b3d-7ce0-4b6b-93c7-d76eb155ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d64e133-9feb-46c1-a838-736a2087d340', 'volume_name': 'volume-1d64e133-9feb-46c1-a838-736a2087d340', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebce182-593b-4002-9b7e-e33d51b34c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebce182-593b-4002-9b7e-e33d51b34c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31f68d0-e561-4704-aef6-5e91900f0e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:48 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Volume 1d64e133-9feb-46c1-a838-736a2087d340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d64e133-9feb-46c1-a838-736a2087d340', 'volume_size': 1} Jul 07 17:26:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:49 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909" returned: 0 in 1.120s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] <== create_volume: return (2613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.616s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.375s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03331ba3-7bf5-4a92-930e-5bafad0f1708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1340a2cb-699c-41d8-8535-7b9c674e8909', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc188b7-9639-4646-af04-36dbc14c7003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Creating offline snapshot 5eaf7773-978a-4431-b9d9-157456d543f6 of volume e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:26:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Volume volume-1340a2cb-699c-41d8-8535-7b9c674e8909 (1340a2cb-699c-41d8-8535-7b9c674e8909): created successfully Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc188b7-9639-4646-af04-36dbc14c7003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Flow 'volume_create_manager' (37631a37-59a6-409b-805c-98472a11fefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cd1548-b03f-4590-9cdd-c66e88e6d808]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7eb284bd-f148-4496-a3f4-2d9fecdefedd tempest-VolumesTestJSON-1533175491 None] Created volume successfully. Jul 07 17:26:49 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 Jul 07 17:26:49 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:50 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8" returned: 0 in 1.130s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:50 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 1G Jul 07 17:26:50 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Flow 'volume_create_manager' (37a2c633-115e-42d4-b4af-1b49536bf37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fec733-0f6f-4abc-8092-ff5f3196098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fec733-0f6f-4abc-8092-ff5f3196098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1027832743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483d42ed-de37-4b33-825d-df7ae2f5292d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ccb815f4e4d22a2c49f47976d7676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:51Z,use_quota=True,user_id='7717628fb8e4470985108c084b6345c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91eef4a-5a9f-4491-bd13-9fee15780071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91eef4a-5a9f-4491-bd13-9fee15780071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e436b471-4818-41cb-9baa-25498770e717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e436b471-4818-41cb-9baa-25498770e717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483d42ed-de37-4b33-825d-df7ae2f5292d', 'volume_name': 'volume-483d42ed-de37-4b33-825d-df7ae2f5292d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709a1ba6-ee51-493e-88c7-caeac7ba39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709a1ba6-ee51-493e-88c7-caeac7ba39ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86886ea4-55d7-4113-99d1-4319fad04d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:50 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Volume 483d42ed-de37-4b33-825d-df7ae2f5292d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483d42ed-de37-4b33-825d-df7ae2f5292d', 'volume_size': 1} Jul 07 17:26:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:51 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 1G" returned: 0 in 1.168s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:51 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 Jul 07 17:26:51 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:52 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6" returned: 0 in 1.015s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:52 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 is being set with open permissions: ugo+rw Jul 07 17:26:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:52 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 Jul 07 17:26:52 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:53 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6" returned: 0 in 0.962s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:53 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info Jul 07 17:26:53 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:54 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info" returned: 0 in 0.748s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:54 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info is being set with open permissions: ugo+rw Jul 07 17:26:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:54 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info Jul 07 17:26:54 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:54 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.info" returned: 0 in 0.693s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.902s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.945s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-463314870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d64e133-9feb-46c1-a838-736a2087d340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0023d9aa4b8f4780a87cd7cbf1adc8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:48Z,use_quota=True,user_id='c659848e56a947c695eb25f7c2c4ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Creating volume 1d64e133-9feb-46c1-a838-736a2087d340 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:55 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:55 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 1073741824 Jul 07 17:26:55 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-871b84ed-07a8-41ea-983c-83746712f818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Create snapshot completed successfully Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "cinder-5eaf7773-978a-4431-b9d9-157456d543f6-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-5eaf7773-978a-4431-b9d9-157456d543f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "cinder-quobyte-e62955e7-fdd5-4df5-b245-4d304f78e7e8" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-quobyte-e62955e7-fdd5-4df5-b245-4d304f78e7e8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "cinder-quobyte-5eaf7773-978a-4431-b9d9-157456d543f6" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-quobyte-5eaf7773-978a-4431-b9d9-157456d543f6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Deleting offline snapshot 5eaf7773-978a-4431-b9d9-157456d543f6 of volume e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] snapshot_file for this snap is: volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae9ef9a-7c5f-4108-8dd8-f1c8cc0345e5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:56 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 Jul 07 17:26:56 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:56 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 1073741824" returned: 0 in 1.228s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:56 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 Jul 07 17:26:56 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:56 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6" returned: 0 in 0.839s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:26:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa2f58-a61c-400c-9dc6-7c8cc67f83ae]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:56 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 Jul 07 17:26:56 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:57 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340" returned: 0 in 0.878s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.334s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1027832743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483d42ed-de37-4b33-825d-df7ae2f5292d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ccb815f4e4d22a2c49f47976d7676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:51Z,use_quota=True,user_id='7717628fb8e4470985108c084b6345c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Creating volume 483d42ed-de37-4b33-825d-df7ae2f5292d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:57 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31f68d0-e561-4704-aef6-5e91900f0e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d64e133-9feb-46c1-a838-736a2087d340', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb2ee1c-b009-4557-a90c-527f93a0f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:57 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d 1073741824 Jul 07 17:26:57 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Volume volume-1d64e133-9feb-46c1-a838-736a2087d340 (1d64e133-9feb-46c1-a838-736a2087d340): created successfully Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb2ee1c-b009-4557-a90c-527f93a0f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Flow 'volume_create_manager' (59c05eb0-5d9a-4e6f-8fc9-0cbe4b20aa67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ffb6cba8-2778-4fe3-b84f-d6b46c590100 tempest-ServerRescueNegativeTestJSON-1086494079 None] Created volume successfully. Jul 07 17:26:57 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8" returned: 0 in 0.990s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:57 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 Jul 07 17:26:57 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:58 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d 1073741824" returned: 0 in 1.667s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:58 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d Jul 07 17:26:58 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:59 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6" returned: 0 in 1.289s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:59 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6 Jul 07 17:26:59 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:59 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d" returned: 0 in 0.828s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] <== create_volume: return (2572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.580s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86886ea4-55d7-4113-99d1-4319fad04d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483d42ed-de37-4b33-825d-df7ae2f5292d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902fdb3a-d11b-4055-a126-d033c0fb8dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Volume volume-483d42ed-de37-4b33-825d-df7ae2f5292d (483d42ed-de37-4b33-825d-df7ae2f5292d): created successfully Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902fdb3a-d11b-4055-a126-d033c0fb8dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Flow 'volume_create_manager' (37a2c633-115e-42d4-b4af-1b49536bf37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:59 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8.5eaf7773-978a-4431-b9d9-157456d543f6" returned: 0 in 0.835s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cbcd8943-fcc5-48f3-90b1-fc18d9b942cc tempest-VolumesTestJSON-1533175491 None] Created volume successfully. Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-quobyte-5eaf7773-978a-4431-b9d9-157456d543f6" released by "_delete_snapshot" :: held 4.118s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-quobyte-e62955e7-fdd5-4df5-b245-4d304f78e7e8" released by "delete_snapshot" :: held 4.154s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:00 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Created reservations ['49828ba8-2f72-45d3-917c-df54135de031', 'b543e253-6c54-4a12-bea6-dafc25e7cc63', '9160ef95-6b46-48c8-8efd-d334ec6ce3d5', 'f0be1617-2c1a-4289-9cb7-31321ec11881'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Delete snapshot completed successfully. Jul 07 17:27:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b5a9936b-0bee-4097-a8b6-c65671c3a102 tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-5eaf7773-978a-4431-b9d9-157456d543f6-delete_snapshot" released by "delete_snapshot" :: held 4.352s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "cinder-e62955e7-fdd5-4df5-b245-4d304f78e7e8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-e62955e7-fdd5-4df5-b245-4d304f78e7e8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "cinder-quobyte-e62955e7-fdd5-4df5-b245-4d304f78e7e8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-quobyte-e62955e7-fdd5-4df5-b245-4d304f78e7e8" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb41793-c521-4de6-971d-be2535afa2a8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:01 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 Jul 07 17:27:01 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "cinder-483d42ed-de37-4b33-825d-df7ae2f5292d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-483d42ed-de37-4b33-825d-df7ae2f5292d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "cinder-quobyte-483d42ed-de37-4b33-825d-df7ae2f5292d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-quobyte-483d42ed-de37-4b33-825d-df7ae2f5292d" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc38897-d270-40bf-9cc4-286b93335246]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:01 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d Jul 07 17:27:01 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:02 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8" returned: 0 in 0.878s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:02 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8 Jul 07 17:27:02 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:02 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d" returned: 0 in 0.793s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:02 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d Jul 07 17:27:02 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:03 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e62955e7-fdd5-4df5-b245-4d304f78e7e8" returned: 0 in 0.815s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-quobyte-e62955e7-fdd5-4df5-b245-4d304f78e7e8" released by "delete_volume" :: held 1.778s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Created reservations ['d628af6b-c9ee-46a4-9f52-e6e39a0b6494', 'ae732161-3f4a-49c8-b97a-2591c39074ab', '3615ef41-2fa4-4125-a82d-b35c46afabf3', '86f17c2d-504c-4cd5-af38-c9633d956a65'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:03 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-483d42ed-de37-4b33-825d-df7ae2f5292d" returned: 0 in 0.696s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:03 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:03 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-quobyte-483d42ed-de37-4b33-825d-df7ae2f5292d" released by "delete_volume" :: held 1.533s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Created reservations ['34af0c0f-6605-441c-86fe-6dea8e2a1140', '07352ccc-e794-407d-b9da-ada69f7ae39e', 'dc75c547-8fa6-4c5c-a4bf-9610549278c9', '7c9907f3-1eee-47e4-8e63-6081358823cf'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:03 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:03 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "cinder-1340a2cb-699c-41d8-8535-7b9c674e8909-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-1340a2cb-699c-41d8-8535-7b9c674e8909-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "cinder-quobyte-1340a2cb-699c-41d8-8535-7b9c674e8909" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-quobyte-1340a2cb-699c-41d8-8535-7b9c674e8909" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fdb6db-29a6-4b19-a40d-33c652e80b23]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:04 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.986s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Deleted volume successfully. Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2b0f32e-d9cc-469c-a24f-491e852b4ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1919867222 None] Lock "cinder-e62955e7-fdd5-4df5-b245-4d304f78e7e8-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:04 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 Jul 07 17:27:04 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:04 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.903s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Deleted volume successfully. Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-07216bf9-85a0-4107-9b54-7611bf6ea770 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-483d42ed-de37-4b33-825d-df7ae2f5292d-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:04 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909" returned: 0 in 0.811s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:04 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909 Jul 07 17:27:05 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1340a2cb-699c-41d8-8535-7b9c674e8909" returned: 0 in 0.752s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-quobyte-1340a2cb-699c-41d8-8535-7b9c674e8909" released by "delete_volume" :: held 1.630s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:05 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=104,cinder:SELECT=64,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=73,cinder:INSERT=24,cinder:UPDATE=88,cinder:DELETE=12 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Created reservations ['40b65429-da4e-45c1-9c95-df6e678edd78', '1b72afdd-6113-4037-83c4-44fa21edc2bb', 'd2764e01-7032-44c5-aa8d-155fae7a8f19', 'c45e2ea1-bc32-4c1d-8e26-ca7460620b20'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:05 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:05 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "cinder-da600d1f-d555-4893-9282-e3384ccd4ca8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-da600d1f-d555-4893-9282-e3384ccd4ca8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "cinder-quobyte-da600d1f-d555-4893-9282-e3384ccd4ca8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-quobyte-da600d1f-d555-4893-9282-e3384ccd4ca8" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[429f47b2-ec73-4fed-a7b4-e8572aae9621]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:06 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 Jul 07 17:27:06 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:06 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.931s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Deleted volume successfully. Jul 07 17:27:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b18a56e0-5a98-4e07-a5fb-7c4a2b2f6f54 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-1340a2cb-699c-41d8-8535-7b9c674e8909-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:07 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8" returned: 0 in 1.119s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:07 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8 Jul 07 17:27:07 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:08 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-da600d1f-d555-4893-9282-e3384ccd4ca8" returned: 0 in 0.874s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-quobyte-da600d1f-d555-4893-9282-e3384ccd4ca8" released by "delete_volume" :: held 2.072s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Created reservations ['09d09b6d-85b0-4434-b5ba-521668b7136c', '26fc635f-6f63-4db4-ab15-eb7956fd3d26', 'c1ad8e2c-f173-4fee-8f27-b6fecd54a380', '01d32aa7-2628-4526-a488-f6147ebf1664'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:08 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:08 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:09 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.812s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:09 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Deleted volume successfully. Jul 07 17:27:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-53100bb4-6d4e-4d7e-a3b5-f9bc60cac4f2 tempest-VolumesTestJSON-1533175491 None] Lock "cinder-da600d1f-d555-4893-9282-e3384ccd4ca8-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Flow 'volume_create_manager' (30d76ec2-a080-4d71-ad49-bbc8006786cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67680e87-f301-4f8f-a33b-dddca155b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67680e87-f301-4f8f-a33b-dddca155b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1309963416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a88559-2ae8-43ec-aae2-72c952490d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1aa8177e294f4ab16abdf89bcc742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:13Z,use_quota=True,user_id='b92f48cefd1a4f3babb60bbe94b326dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd5844b8-4065-485c-ad94-6f496fa6d7e3),volume_type_id=cd5844b8-4065-485c-ad94-6f496fa6d7e3)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cc11ae-157c-4717-ac2b-0e5478514c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cc11ae-157c-4717-ac2b-0e5478514c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a293b786-e2f9-42fc-a1ef-6dc5c9667bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a293b786-e2f9-42fc-a1ef-6dc5c9667bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59a88559-2ae8-43ec-aae2-72c952490d29', 'volume_name': 'volume-59a88559-2ae8-43ec-aae2-72c952490d29', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1579a0bb-21a6-4606-b1ba-f999d78a617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1579a0bb-21a6-4606-b1ba-f999d78a617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3639b62-f4fc-4e9d-b5b2-ea3cd19a29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Volume 59a88559-2ae8-43ec-aae2-72c952490d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59a88559-2ae8-43ec-aae2-72c952490d29', 'volume_size': 1} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1309963416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a88559-2ae8-43ec-aae2-72c952490d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1aa8177e294f4ab16abdf89bcc742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:13Z,use_quota=True,user_id='b92f48cefd1a4f3babb60bbe94b326dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd5844b8-4065-485c-ad94-6f496fa6d7e3),volume_type_id=cd5844b8-4065-485c-ad94-6f496fa6d7e3)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Creating volume 59a88559-2ae8-43ec-aae2-72c952490d29 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:12 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:27:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:12 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 1073741824 Jul 07 17:27:12 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:13 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 1073741824" returned: 0 in 1.147s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:14 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 Jul 07 17:27:14 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:14 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29" returned: 0 in 0.687s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3639b62-f4fc-4e9d-b5b2-ea3cd19a29de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59a88559-2ae8-43ec-aae2-72c952490d29', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7508244e-bc5b-48ca-9bae-d85b8c911ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:14 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Volume volume-59a88559-2ae8-43ec-aae2-72c952490d29 (59a88559-2ae8-43ec-aae2-72c952490d29): created successfully Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7508244e-bc5b-48ca-9bae-d85b8c911ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Flow 'volume_create_manager' (30d76ec2-a080-4d71-ad49-bbc8006786cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-89a76dae-7b7f-4ba2-b87f-dbcf419281b9 tempest-VolumeTypesAccessTest-1276833931 None] Created volume successfully. Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Acquiring lock "cinder-59a88559-2ae8-43ec-aae2-72c952490d29-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Lock "cinder-59a88559-2ae8-43ec-aae2-72c952490d29-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Acquiring lock "cinder-quobyte-59a88559-2ae8-43ec-aae2-72c952490d29" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46ab0266-aca7-4be7-9149-89be917af228 tempest-GroupsV320Test-938710241 None] Group tempest-GroupsV320Test-Group-733742827: creating Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Lock "cinder-quobyte-59a88559-2ae8-43ec-aae2-72c952490d29" acquired by "delete_volume" :: waited 0.040s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc38e611-f7e2-41b1-bc83-f104ed9e4554]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46ab0266-aca7-4be7-9149-89be917af228 tempest-GroupsV320Test-938710241 None] Group tempest-GroupsV320Test-Group-733742827: created successfully Jul 07 17:27:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-46ab0266-aca7-4be7-9149-89be917af228 tempest-GroupsV320Test-938710241 None] Create group completed successfully. Jul 07 17:27:16 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 Jul 07 17:27:16 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Acquiring lock "cinder-1d64e133-9feb-46c1-a838-736a2087d340-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "cinder-1d64e133-9feb-46c1-a838-736a2087d340-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Acquiring lock "cinder-quobyte-1d64e133-9feb-46c1-a838-736a2087d340" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "cinder-quobyte-1d64e133-9feb-46c1-a838-736a2087d340" acquired by "delete_volume" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc942b-1e62-4b6d-bc45-85c9da9bd576]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:17 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 Jul 07 17:27:17 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:17 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29" returned: 0 in 1.250s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:17 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29 Jul 07 17:27:17 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Created reservations ['c05e469f-6c6f-44f7-81e3-98d74d21c52c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:18 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340" returned: 0 in 1.514s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:18 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:18 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:18 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340 Jul 07 17:27:18 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:18 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-59a88559-2ae8-43ec-aae2-72c952490d29" returned: 0 in 1.231s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Lock "cinder-quobyte-59a88559-2ae8-43ec-aae2-72c952490d29" released by "delete_volume" :: held 2.568s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:18 devstack cinder-volume[87251]: WARNING cinder.quota [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-973955843 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-973955843, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:27:18 devstack cinder-volume[87251]: WARNING cinder.quota [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-973955843 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-973955843, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Created reservations ['47879b1b-b140-4113-b669-f8b07c53d6ad', '23b17264-dd6b-4871-8501-d086e3ea8bb8', '653bd3b6-e608-49c1-b579-23acc2a12d7a', '960364e1-e93d-4087-b5eb-a04535a878da'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:19 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:19 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:19 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.903s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b1de615d-770b-433f-8b79-34cc2bc3d2dd tempest-GroupsV320Test-938710241 None] Delete group completed successfully. Jul 07 17:27:19 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1d64e133-9feb-46c1-a838-736a2087d340" returned: 0 in 0.937s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "cinder-quobyte-1d64e133-9feb-46c1-a838-736a2087d340" released by "delete_volume" :: held 2.539s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Created reservations ['cde89108-7827-46b1-a846-3462c9be10ab', 'e84d01c2-403b-4512-a71a-5d06ad96be70', 'c3703298-7e1d-4e9e-b2e3-c00eab88a4c4', 'f75bea1a-b9e3-466e-a981-8b5aead64c44'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:19 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:19 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:20 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.200s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:20 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Deleted volume successfully. Jul 07 17:27:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-58269939-bc5b-4b0c-9fa1-797857443764 tempest-VolumeTypesAccessTest-1276833931 None] Lock "cinder-59a88559-2ae8-43ec-aae2-72c952490d29-delete_volume" released by "delete_volume" :: held 4.169s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:20 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.232s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:20 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Deleted volume successfully. Jul 07 17:27:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d575422-80f8-4d44-ac71-db8571f4550d tempest-ServerRescueNegativeTestJSON-1086494079 None] Lock "cinder-1d64e133-9feb-46c1-a838-736a2087d340-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:29 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=40,cinder:SELECT=24,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:30 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=29,cinder:INSERT=13,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:32 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:32 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:33 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.840s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:27:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:27:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Flow 'volume_create_manager' (ae652f55-d303-44f5-9b55-79dc8e54e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b0d36-399e-40ec-a85d-3a3d09a1cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b0d36-399e-40ec-a85d-3a3d09a1cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-922983178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba05177-b0e5-4e5a-a15f-67a2b9704b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fefd9bcc3a74a3883d5b1bb4661b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:39Z,use_quota=True,user_id='5d1fac19c4f8443392bb42f8c72f60c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a588e5-fa3a-4da6-a892-06510987cbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a588e5-fa3a-4da6-a892-06510987cbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8a144a-5546-408f-81ef-d2444694037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8a144a-5546-408f-81ef-d2444694037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba05177-b0e5-4e5a-a15f-67a2b9704b35', 'volume_name': 'volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21b1a63-2fb7-4c60-bea3-a26b78cb8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21b1a63-2fb7-4c60-bea3-a26b78cb8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741d08de-20da-48cd-92ce-48046f7615b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Volume 1ba05177-b0e5-4e5a-a15f-67a2b9704b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35', 'volume_size': 1} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-922983178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba05177-b0e5-4e5a-a15f-67a2b9704b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fefd9bcc3a74a3883d5b1bb4661b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:39Z,use_quota=True,user_id='5d1fac19c4f8443392bb42f8c72f60c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Creating volume 1ba05177-b0e5-4e5a-a15f-67a2b9704b35 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:39 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:27:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:39 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 1073741824 Jul 07 17:27:39 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:41 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 1073741824" returned: 0 in 1.546s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:41 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 Jul 07 17:27:41 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:42 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35" returned: 0 in 0.897s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] <== create_volume: return (2506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741d08de-20da-48cd-92ce-48046f7615b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9aabbc-a1b5-4db4-b51a-9997f5e7b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Volume volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 (1ba05177-b0e5-4e5a-a15f-67a2b9704b35): created successfully Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9aabbc-a1b5-4db4-b51a-9997f5e7b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Flow 'volume_create_manager' (ae652f55-d303-44f5-9b55-79dc8e54e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a01afc46-dd49-46b1-a4bc-a17a274f4025 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Created volume successfully. Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "cinder-1ba05177-b0e5-4e5a-a15f-67a2b9704b35-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "cinder-1ba05177-b0e5-4e5a-a15f-67a2b9704b35-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "cinder-quobyte-1ba05177-b0e5-4e5a-a15f-67a2b9704b35" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "cinder-quobyte-1ba05177-b0e5-4e5a-a15f-67a2b9704b35" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f05c0a1-187f-4f4f-92da-63ca7d51e59a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:43 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 Jul 07 17:27:43 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:44 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35" returned: 0 in 1.220s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:44 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35 Jul 07 17:27:44 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:45 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1ba05177-b0e5-4e5a-a15f-67a2b9704b35" returned: 0 in 1.100s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "cinder-quobyte-1ba05177-b0e5-4e5a-a15f-67a2b9704b35" released by "delete_volume" :: held 2.387s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Created reservations ['980ac610-6def-4e47-9c29-7012b17bdfdc', '7cdf0787-77cd-48b4-8377-a4a2b0cf1150', '74ae78ba-e263-4cc2-89bb-15c82ffad7d5', '3346ee16-89a3-4cd9-a55e-4dfafb58bf79'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:45 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:45 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Flow 'volume_create_manager' (16cd31a4-d5f2-4e00-b198-33e858e09a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c850a4-3f53-402c-8150-3884b7dce9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c850a4-3f53-402c-8150-3884b7dce9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1084455628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6e276f-f959-46b2-84f3-4f7924dc9463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eeb4bc21ac4775a9f7b27c4bdadf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:46Z,use_quota=True,user_id='ba20e170e4e34466ae81a2b007c4f8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93392d4f-d64a-47a4-85d5-3db3541407f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93392d4f-d64a-47a4-85d5-3db3541407f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410236cc-eafa-4813-9808-a3d676a1be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410236cc-eafa-4813-9808-a3d676a1be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6e276f-f959-46b2-84f3-4f7924dc9463', 'volume_name': 'volume-ef6e276f-f959-46b2-84f3-4f7924dc9463', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e02992-f787-450c-bcc6-e752e34da13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e02992-f787-450c-bcc6-e752e34da13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af5c93d-1305-4135-bb55-aae1c5d305e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Volume ef6e276f-f959-46b2-84f3-4f7924dc9463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6e276f-f959-46b2-84f3-4f7924dc9463', 'volume_size': 1} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1084455628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6e276f-f959-46b2-84f3-4f7924dc9463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eeb4bc21ac4775a9f7b27c4bdadf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:46Z,use_quota=True,user_id='ba20e170e4e34466ae81a2b007c4f8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Creating volume ef6e276f-f959-46b2-84f3-4f7924dc9463 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:46 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:46 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 1073741824 Jul 07 17:27:46 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:46 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.253s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Deleted volume successfully. Jul 07 17:27:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d15094cd-a87a-46fd-b751-543be5d8321f tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "cinder-1ba05177-b0e5-4e5a-a15f-67a2b9704b35-delete_volume" released by "delete_volume" :: held 4.069s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Flow 'volume_create_manager' (f9c46122-c7fd-470d-9d7d-6c417082ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd39af48-d6ba-41c8-ac62-1d2bd47eebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd39af48-d6ba-41c8-ac62-1d2bd47eebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-389549786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d11fa5-9e65-42cd-8b16-27ef0c69c6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fefd9bcc3a74a3883d5b1bb4661b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:48Z,use_quota=True,user_id='5d1fac19c4f8443392bb42f8c72f60c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b8942a-458c-4a71-83c8-561faf3bad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b8942a-458c-4a71-83c8-561faf3bad8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d951561-47ff-4a2c-a81c-ac97639e4670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d951561-47ff-4a2c-a81c-ac97639e4670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d11fa5-9e65-42cd-8b16-27ef0c69c6c7', 'volume_name': 'volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6816356-622a-4f52-8db0-1fbff8e3336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6816356-622a-4f52-8db0-1fbff8e3336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3806ed3-8658-46cd-860c-9eb81a3fb366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:47 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Volume 97d11fa5-9e65-42cd-8b16-27ef0c69c6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7', 'volume_size': 1} Jul 07 17:27:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:47 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 1073741824" returned: 0 in 1.304s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:48 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 Jul 07 17:27:48 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:48 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463" returned: 0 in 0.886s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-389549786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d11fa5-9e65-42cd-8b16-27ef0c69c6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fefd9bcc3a74a3883d5b1bb4661b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:48Z,use_quota=True,user_id='5d1fac19c4f8443392bb42f8c72f60c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Creating volume 97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:48 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af5c93d-1305-4135-bb55-aae1c5d305e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6e276f-f959-46b2-84f3-4f7924dc9463', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0969a7f6-b4c7-4b7f-aac2-baea31b3a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:49 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 1073741824 Jul 07 17:27:49 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Volume volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 (ef6e276f-f959-46b2-84f3-4f7924dc9463): created successfully Jul 07 17:27:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0969a7f6-b4c7-4b7f-aac2-baea31b3a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Flow 'volume_create_manager' (16cd31a4-d5f2-4e00-b198-33e858e09a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-66b5dfa3-9bc0-46f9-ad05-355afc705d65 tempest-VolumesMetadataTest-145498664 None] Created volume successfully. Jul 07 17:27:50 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 1073741824" returned: 0 in 1.265s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:50 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 Jul 07 17:27:50 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Acquiring lock "cinder-ef6e276f-f959-46b2-84f3-4f7924dc9463-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Lock "cinder-ef6e276f-f959-46b2-84f3-4f7924dc9463-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Acquiring lock "cinder-quobyte-ef6e276f-f959-46b2-84f3-4f7924dc9463" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Lock "cinder-quobyte-ef6e276f-f959-46b2-84f3-4f7924dc9463" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b31de-ca3a-48b5-a9ba-d8d021b912d6]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:51 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 Jul 07 17:27:51 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:51 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7" returned: 0 in 0.869s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3806ed3-8658-46cd-860c-9eb81a3fb366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87f07d0-aea0-40f0-92f7-cf3e0251e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:51 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Volume volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 (97d11fa5-9e65-42cd-8b16-27ef0c69c6c7): created successfully Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87f07d0-aea0-40f0-92f7-cf3e0251e902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Flow 'volume_create_manager' (f9c46122-c7fd-470d-9d7d-6c417082ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-933e860a-8d35-4883-aca8-f6e2feeab004 tempest-VolumeQuotasAdminTestJSON-1524968387 None] Created volume successfully. Jul 07 17:27:52 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463" returned: 0 in 1.204s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:52 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463 Jul 07 17:27:52 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:52 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c69b6f77-8b25-4ef0-8af4-a619bf1c0732 tempest-VolumeQuotasAdminTestJSON-412588397 None] Transfer volume completed successfully. Jul 07 17:27:53 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6e276f-f959-46b2-84f3-4f7924dc9463" returned: 0 in 1.073s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Lock "cinder-quobyte-ef6e276f-f959-46b2-84f3-4f7924dc9463" released by "delete_volume" :: held 2.330s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Created reservations ['2ae71218-2e57-4228-919a-d724810e7c00', 'd384ef80-b3fe-4450-9cd8-ae14d24b51d8', '6dec87ca-0a77-4a99-be10-aa3a29cf1033', '49e48eb3-b716-45be-b1b4-ab2789ab9b23'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:53 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:53 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Acquiring lock "cinder-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Lock "cinder-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Acquiring lock "cinder-quobyte-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:54 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Lock "cinder-quobyte-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7" acquired by "delete_volume" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.077s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:54 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Deleted volume successfully. Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6515b58-854d-440e-bb5f-a2df3eb6784b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4727ecf1-4e11-4c1d-9230-3dac08627abe tempest-VolumesMetadataTest-145498664 None] Lock "cinder-ef6e276f-f959-46b2-84f3-4f7924dc9463-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:54 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 Jul 07 17:27:54 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:55 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7" returned: 0 in 1.339s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:55 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7 Jul 07 17:27:55 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:56 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7" returned: 0 in 0.862s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Lock "cinder-quobyte-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7" released by "delete_volume" :: held 2.286s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Created reservations ['b8494419-676f-493b-9fa7-73664d2dce18', '2c161899-c676-4da2-bca8-44009b4295f4', '201dcf96-ed1c-4859-8ffc-6f8a6933a32a', '49a866a3-1e94-45e0-b2fb-d68bae55e6b6'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:56 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:27:56 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:57 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.673s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:57 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Deleted volume successfully. Jul 07 17:27:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-68099e96-34e7-4d88-8ff5-bdbd3af0f8a8 tempest-VolumeQuotasAdminTestJSON-383104092 None] Lock "cinder-97d11fa5-9e65-42cd-8b16-27ef0c69c6c7-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Flow 'volume_create_manager' (afe430f2-919a-49c0-a9c3-64fad87b3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3abe731-475e-4c5e-9fae-678d0f123a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3abe731-475e-4c5e-9fae-678d0f123a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-820415220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54af179d-4ab8-4716-99c7-36a5521d7b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fc0574d46f42e5b8768fc0d3a03448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:01Z,use_quota=True,user_id='52a00a7060ab45399013454c85c369c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c33211f-e27c-407b-9ef3-bcf9f392370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c33211f-e27c-407b-9ef3-bcf9f392370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c4b54f-f8a0-49e7-a9a8-7a47a025b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c4b54f-f8a0-49e7-a9a8-7a47a025b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54af179d-4ab8-4716-99c7-36a5521d7b6f', 'volume_name': 'volume-54af179d-4ab8-4716-99c7-36a5521d7b6f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05364499-882f-461f-98f7-8c4e5a890529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05364499-882f-461f-98f7-8c4e5a890529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbd1a1b-2968-48a2-b50b-942a0f253749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Volume 54af179d-4ab8-4716-99c7-36a5521d7b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54af179d-4ab8-4716-99c7-36a5521d7b6f', 'volume_size': 1} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-820415220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54af179d-4ab8-4716-99c7-36a5521d7b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fc0574d46f42e5b8768fc0d3a03448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:01Z,use_quota=True,user_id='52a00a7060ab45399013454c85c369c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Creating volume 54af179d-4ab8-4716-99c7-36a5521d7b6f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:00 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f 1073741824 Jul 07 17:28:00 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:01 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f 1073741824" returned: 0 in 0.983s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:01 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f Jul 07 17:28:01 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:02 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f" returned: 0 in 0.766s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbd1a1b-2968-48a2-b50b-942a0f253749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54af179d-4ab8-4716-99c7-36a5521d7b6f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0f1bd2-69e5-4b09-942b-893edf4058e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Volume volume-54af179d-4ab8-4716-99c7-36a5521d7b6f (54af179d-4ab8-4716-99c7-36a5521d7b6f): created successfully Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0f1bd2-69e5-4b09-942b-893edf4058e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Flow 'volume_create_manager' (afe430f2-919a-49c0-a9c3-64fad87b3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8ed9d3fa-268b-4f1a-9e17-b9f6df4a444a tempest-VolumesTransfersV355Test-1454192591 None] Created volume successfully. Jul 07 17:28:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bfb53e8b-0878-45e0-91b9-5b1a6593d2e8 tempest-VolumesTransfersV355Test-2052677349 None] Transfer volume completed successfully. Jul 07 17:28:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Acquiring lock "cinder-54af179d-4ab8-4716-99c7-36a5521d7b6f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-54af179d-4ab8-4716-99c7-36a5521d7b6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Acquiring lock "cinder-quobyte-54af179d-4ab8-4716-99c7-36a5521d7b6f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-quobyte-54af179d-4ab8-4716-99c7-36a5521d7b6f" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[90131d6f-6479-4387-9cdc-b783e03129be]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:06 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f Jul 07 17:28:06 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:07 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f" returned: 0 in 0.876s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:07 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f Jul 07 17:28:07 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:07 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-54af179d-4ab8-4716-99c7-36a5521d7b6f" returned: 0 in 0.741s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-quobyte-54af179d-4ab8-4716-99c7-36a5521d7b6f" released by "delete_volume" :: held 1.663s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Created reservations ['f7765b3e-04ea-40dd-99af-3943b1f1a17b', '2a70bac1-d749-4d53-817a-ade23352a67a', '46051b78-5b93-4ffc-b92e-2387995a83e2', '61a5389f-f544-4150-b640-c902dc452e24'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:07 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:28:07 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:08 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.000s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:08 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Deleted volume successfully. Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9597a108-b0c3-4021-8487-b0344dcd8c01 tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-54af179d-4ab8-4716-99c7-36a5521d7b6f-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Flow 'volume_create_manager' (e5b2422a-c908-4543-bba2-c6e313378036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee76ff8e-27fd-4c43-b09b-44f4d60a5655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee76ff8e-27fd-4c43-b09b-44f4d60a5655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-41574264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e80c8f-5041-478a-8237-9cb130251037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d32ea08c43342bf9ebf0309305ac64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:09Z,use_quota=True,user_id='39e40ffe59834029ba1d438cd05b3a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dab165-33ab-4fee-bc32-c8fd5387e4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dab165-33ab-4fee-bc32-c8fd5387e4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d8bf59-f853-4bc2-807e-f0c118c8bb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d8bf59-f853-4bc2-807e-f0c118c8bb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e80c8f-5041-478a-8237-9cb130251037', 'volume_name': 'volume-26e80c8f-5041-478a-8237-9cb130251037', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22561d0a-528b-4929-b37d-e7ec6ddfbc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22561d0a-528b-4929-b37d-e7ec6ddfbc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8afb84-8a98-4f5c-a747-c5ff5cd14bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Volume 26e80c8f-5041-478a-8237-9cb130251037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e80c8f-5041-478a-8237-9cb130251037', 'volume_size': 1} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-41574264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e80c8f-5041-478a-8237-9cb130251037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d32ea08c43342bf9ebf0309305ac64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:09Z,use_quota=True,user_id='39e40ffe59834029ba1d438cd05b3a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Creating volume 26e80c8f-5041-478a-8237-9cb130251037 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:09 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 1073741824 Jul 07 17:28:09 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Flow 'volume_create_manager' (85364ddc-4769-4065-8f72-ed43760f5261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c712108-87bc-43c2-bc34-1416e35efd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c712108-87bc-43c2-bc34-1416e35efd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-665123866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fcd424-40ca-4810-97db-64ef89ac6524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fc0574d46f42e5b8768fc0d3a03448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:09Z,use_quota=True,user_id='52a00a7060ab45399013454c85c369c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f0a3e0-750d-4088-b6ed-82c76b5da4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f0a3e0-750d-4088-b6ed-82c76b5da4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd3ae34-3a7c-427d-8824-8b9346ad2007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd3ae34-3a7c-427d-8824-8b9346ad2007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fcd424-40ca-4810-97db-64ef89ac6524', 'volume_name': 'volume-e2fcd424-40ca-4810-97db-64ef89ac6524', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1187caa1-24d6-4c14-b612-8292207e423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1187caa1-24d6-4c14-b612-8292207e423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5971cc-4958-4b82-a1fd-3ce15cdbfc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Volume e2fcd424-40ca-4810-97db-64ef89ac6524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fcd424-40ca-4810-97db-64ef89ac6524', 'volume_size': 1} Jul 07 17:28:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:10 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 1073741824" returned: 0 in 1.350s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:11 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 Jul 07 17:28:11 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:11 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037" returned: 0 in 0.679s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.847s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-665123866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fcd424-40ca-4810-97db-64ef89ac6524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fc0574d46f42e5b8768fc0d3a03448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:09Z,use_quota=True,user_id='52a00a7060ab45399013454c85c369c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Creating volume e2fcd424-40ca-4810-97db-64ef89ac6524 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:11 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:11 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 1073741824 Jul 07 17:28:11 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8afb84-8a98-4f5c-a747-c5ff5cd14bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e80c8f-5041-478a-8237-9cb130251037', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1805f1-1231-4c9d-9f1b-e722af5e88f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Volume volume-26e80c8f-5041-478a-8237-9cb130251037 (26e80c8f-5041-478a-8237-9cb130251037): created successfully Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1805f1-1231-4c9d-9f1b-e722af5e88f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Flow 'volume_create_manager' (e5b2422a-c908-4543-bba2-c6e313378036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-11f6afdf-451b-4ba0-8110-2af3c2a59089 tempest-AttachVolumeTestJSON-1764762157 None] Created volume successfully. Jul 07 17:28:12 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 1073741824" returned: 0 in 1.125s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:12 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 Jul 07 17:28:12 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:13 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524" returned: 0 in 0.748s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5971cc-4958-4b82-a1fd-3ce15cdbfc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fcd424-40ca-4810-97db-64ef89ac6524', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed3dd8c-255a-4b6e-a0ba-ab7689a6bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:13 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Volume volume-e2fcd424-40ca-4810-97db-64ef89ac6524 (e2fcd424-40ca-4810-97db-64ef89ac6524): created successfully Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed3dd8c-255a-4b6e-a0ba-ab7689a6bad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Flow 'volume_create_manager' (85364ddc-4769-4065-8f72-ed43760f5261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8366776e-dbae-493d-91a7-e26134f824fc tempest-VolumesTransfersV355Test-1454192591 None] Created volume successfully. Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Acquiring lock "cinder-e2fcd424-40ca-4810-97db-64ef89ac6524-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-e2fcd424-40ca-4810-97db-64ef89ac6524-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Acquiring lock "cinder-quobyte-e2fcd424-40ca-4810-97db-64ef89ac6524" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-quobyte-e2fcd424-40ca-4810-97db-64ef89ac6524" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4268d2-0508-44c5-9514-ce11d6b890c3]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:15 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 Jul 07 17:28:15 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed5c1e-6128-4eec-8c16-0233feaacdc0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:16 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 Jul 07 17:28:16 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:16 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524" returned: 0 in 1.210s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:16 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524 Jul 07 17:28:16 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:17 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037" returned: 0 in 1.238s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.268s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:17 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e2fcd424-40ca-4810-97db-64ef89ac6524" returned: 0 in 0.791s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-26e80c8f-5041-478a-8237-9cb130251037', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ef98fc-1013-44e7-a35b-d2d967a3ab56', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-quobyte-e2fcd424-40ca-4810-97db-64ef89ac6524" released by "delete_volume" :: held 2.058s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Created reservations ['75cd8b32-bc7c-434e-a8c9-ee2b685d3c86', 'df578b81-440c-4fc5-b414-8cd738d4cba1', 'b3f2cecc-bf20-48c4-a620-a03cb31c8f4f', 'b4af80ae-5076-4178-a8b0-e00d4d8309f5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-c88f1a36-0168-4c52-a8ff-04025278e64d req-48009f36-f40a-4fba-b202-ecd30c8ba95d tempest-AttachVolumeTestJSON-1764762157 None] attachment_update completed successfully. Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:17 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:28:17 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:18 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.300s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:18 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Deleted volume successfully. Jul 07 17:28:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6e0295df-9ff0-452e-b350-9d06d129ac4c tempest-VolumesTransfersV355Test-1412046415 None] Lock "cinder-e2fcd424-40ca-4810-97db-64ef89ac6524-delete_volume" released by "delete_volume" :: held 3.781s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Flow 'volume_create_manager' (2feb6e24-0fd2-4190-b33d-390ca6fd6c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea9baf8-b7e1-474a-a42b-080aacbacab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea9baf8-b7e1-474a-a42b-080aacbacab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-245151708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bc3069-aed5-40ec-a133-4adf4c140d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d32ea08c43342bf9ebf0309305ac64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:23Z,use_quota=True,user_id='39e40ffe59834029ba1d438cd05b3a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d10607-d011-43de-b95e-c4355f3a48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d10607-d011-43de-b95e-c4355f3a48ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1364f052-8fd0-4c48-a96d-d169690c7ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1364f052-8fd0-4c48-a96d-d169690c7ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bc3069-aed5-40ec-a133-4adf4c140d14', 'volume_name': 'volume-78bc3069-aed5-40ec-a133-4adf4c140d14', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2251ad52-2f6d-49a2-adc7-55bdf66804cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2251ad52-2f6d-49a2-adc7-55bdf66804cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0070f6-b7bc-4eaa-96d0-6c0cdff74165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:23 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Volume 78bc3069-aed5-40ec-a133-4adf4c140d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bc3069-aed5-40ec-a133-4adf4c140d14', 'volume_size': 1} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-245151708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bc3069-aed5-40ec-a133-4adf4c140d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d32ea08c43342bf9ebf0309305ac64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:23Z,use_quota=True,user_id='39e40ffe59834029ba1d438cd05b3a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Creating volume 78bc3069-aed5-40ec-a133-4adf4c140d14 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:23 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:23 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 1073741824 Jul 07 17:28:23 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:25 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 1073741824" returned: 0 in 1.640s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:25 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 Jul 07 17:28:25 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:26 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14" returned: 0 in 0.933s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] <== create_volume: return (2648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0070f6-b7bc-4eaa-96d0-6c0cdff74165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bc3069-aed5-40ec-a133-4adf4c140d14', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c280e03a-6800-4fe0-bc69-9551a93181c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Volume volume-78bc3069-aed5-40ec-a133-4adf4c140d14 (78bc3069-aed5-40ec-a133-4adf4c140d14): created successfully Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c280e03a-6800-4fe0-bc69-9551a93181c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Flow 'volume_create_manager' (2feb6e24-0fd2-4190-b33d-390ca6fd6c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1256e3fb-2b5e-4270-9ce5-313c0f149ed8 tempest-AttachVolumeTestJSON-1764762157 None] Created volume successfully. Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1da717-4efc-4bab-89be-90b2b210529e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=48,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Flow 'volume_create_manager' (74509c3c-2b46-41b6-946d-d05ec6aa3c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eb6d0f-cccb-48c0-bfa9-3aa24189c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eb6d0f-cccb-48c0-bfa9-3aa24189c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1395930339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee82393c-c59b-4157-aeb2-97d84452ac7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e192ee6c42c415f8d1ae2bd68b384d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:30Z,use_quota=True,user_id='f4d32609b43f40a0bf461c3d78e7750a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:30 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 Jul 07 17:28:30 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053f5fd5-8eb2-4d8d-9f15-c5c8370e2951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053f5fd5-8eb2-4d8d-9f15-c5c8370e2951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581144fc-a8cd-4c33-b379-bd5c34d5ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581144fc-a8cd-4c33-b379-bd5c34d5ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee82393c-c59b-4157-aeb2-97d84452ac7d', 'volume_name': 'volume-ee82393c-c59b-4157-aeb2-97d84452ac7d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc205d2-400f-44f0-b231-db266afd2f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc205d2-400f-44f0-b231-db266afd2f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b37466-84be-40f8-9b3e-917f3fb94a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Volume ee82393c-c59b-4157-aeb2-97d84452ac7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee82393c-c59b-4157-aeb2-97d84452ac7d', 'volume_size': 1} Jul 07 17:28:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:31 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14" returned: 0 in 0.895s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1395930339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee82393c-c59b-4157-aeb2-97d84452ac7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e192ee6c42c415f8d1ae2bd68b384d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:30Z,use_quota=True,user_id='f4d32609b43f40a0bf461c3d78e7750a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Creating volume ee82393c-c59b-4157-aeb2-97d84452ac7d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:31 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=49,cinder:UPDATE=67,cinder:INSERT=12,cinder:DELETE=7 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:31 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d 1073741824 Jul 07 17:28:31 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-78bc3069-aed5-40ec-a133-4adf4c140d14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f06abfb2-9f29-4bff-9ee4-498f1d96572e', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:28:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-98d72367-e338-4b11-9223-fe663bb35cdb req-7505dae4-7613-448a-a54a-b07bcbdb9865 tempest-AttachVolumeTestJSON-1764762157 None] attachment_update completed successfully. Jul 07 17:28:32 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d 1073741824" returned: 0 in 1.067s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:32 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d Jul 07 17:28:32 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:32 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:28:32 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:33 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d" returned: 0 in 0.773s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b37466-84be-40f8-9b3e-917f3fb94a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee82393c-c59b-4157-aeb2-97d84452ac7d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb65b2f-6617-4954-b016-5893c372bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:33 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Volume volume-ee82393c-c59b-4157-aeb2-97d84452ac7d (ee82393c-c59b-4157-aeb2-97d84452ac7d): created successfully Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb65b2f-6617-4954-b016-5893c372bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Flow 'volume_create_manager' (74509c3c-2b46-41b6-946d-d05ec6aa3c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ee45a8e4-8bd8-4957-9b29-8ce4f064bd2c tempest-VolumesNegativeTest-1796789558 None] Created volume successfully. Jul 07 17:28:33 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.751s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:28:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:28:38 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-5c35dfd9-e190-443c-b404-2d726534066c req-0557aac3-91b3-4f45-a539-e898fc0f09e0 tempest-AttachVolumeTestJSON-1764762157 None] Terminate volume connection completed successfully. Jul 07 17:28:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-5c35dfd9-e190-443c-b404-2d726534066c req-0557aac3-91b3-4f45-a539-e898fc0f09e0 tempest-AttachVolumeTestJSON-1764762157 None] Deleting attachment 93ef98fc-1013-44e7-a35b-d2d967a3ab56. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Flow 'volume_create_manager' (03e362f4-48ca-4941-b19d-696587f376c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2711e7a-941e-4952-b711-42d0fb5422c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2711e7a-941e-4952-b711-42d0fb5422c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-952012460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a5d944-1789-4708-92c6-1d55a05407bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9e2d557dd4092a107406792aaf480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:41Z,use_quota=True,user_id='5b8756d0675b4edcb306e2ee7477df1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd86273-895f-4dc5-a67e-c615aa622d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd86273-895f-4dc5-a67e-c615aa622d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8753de63-2114-476c-9a19-56d0eed5abd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8753de63-2114-476c-9a19-56d0eed5abd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a5d944-1789-4708-92c6-1d55a05407bd', 'volume_name': 'volume-14a5d944-1789-4708-92c6-1d55a05407bd', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961f75f0-78ab-4911-9885-4ac1282b91df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961f75f0-78ab-4911-9885-4ac1282b91df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e9d657-41d6-46ab-b709-ca6fe8089c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:41 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Volume 14a5d944-1789-4708-92c6-1d55a05407bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a5d944-1789-4708-92c6-1d55a05407bd', 'volume_size': 1} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-952012460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a5d944-1789-4708-92c6-1d55a05407bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef9e2d557dd4092a107406792aaf480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:41Z,use_quota=True,user_id='5b8756d0675b4edcb306e2ee7477df1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Creating volume 14a5d944-1789-4708-92c6-1d55a05407bd {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:41 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:41 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd 1073741824 Jul 07 17:28:41 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-c570dfb3-cdbd-48f8-9e49-b0134cd10109 req-c49d8185-e523-41f9-803f-2ae671283461 tempest-AttachVolumeTestJSON-1764762157 None] Terminate volume connection completed successfully. Jul 07 17:28:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-c570dfb3-cdbd-48f8-9e49-b0134cd10109 req-c49d8185-e523-41f9-803f-2ae671283461 tempest-AttachVolumeTestJSON-1764762157 None] Deleting attachment f06abfb2-9f29-4bff-9ee4-498f1d96572e. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:28:42 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd 1073741824" returned: 0 in 1.233s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:42 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd Jul 07 17:28:42 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:43 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd" returned: 0 in 0.707s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e9d657-41d6-46ab-b709-ca6fe8089c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a5d944-1789-4708-92c6-1d55a05407bd', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc81f32-2a73-4839-ac27-f10564e9877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:43 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Volume volume-14a5d944-1789-4708-92c6-1d55a05407bd (14a5d944-1789-4708-92c6-1d55a05407bd): created successfully Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc81f32-2a73-4839-ac27-f10564e9877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Flow 'volume_create_manager' (03e362f4-48ca-4941-b19d-696587f376c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-66901fc9-bf16-42a5-8567-90ffe4da259e tempest-AttachVolumeShelveTestJSON-1668771351 None] Created volume successfully. Jul 07 17:28:53 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:53 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "cinder-78bc3069-aed5-40ec-a133-4adf4c140d14-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-78bc3069-aed5-40ec-a133-4adf4c140d14-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "cinder-quobyte-78bc3069-aed5-40ec-a133-4adf4c140d14" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-quobyte-78bc3069-aed5-40ec-a133-4adf4c140d14" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[657ccad7-3d91-4385-bcb3-a15b3cc543c0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:55 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 Jul 07 17:28:55 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:56 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14" returned: 0 in 1.460s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:56 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14 Jul 07 17:28:56 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:57 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-78bc3069-aed5-40ec-a133-4adf4c140d14" returned: 0 in 0.882s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-quobyte-78bc3069-aed5-40ec-a133-4adf4c140d14" released by "delete_volume" :: held 2.425s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Created reservations ['3986893e-24e9-4b13-a740-219c5c856995', '5440529a-33b7-46f8-af12-cf9d5432a315', 'adb0d504-334e-419f-a298-3a12f9920905', 'e9ffa791-5326-4fac-bf98-edd7c158fe79'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:57 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:28:57 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "cinder-26e80c8f-5041-478a-8237-9cb130251037-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-26e80c8f-5041-478a-8237-9cb130251037-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (9678993b-b306-4373-8b63-75b9fe2f7a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512c6be6-27ef-441c-a79e-6221533293b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512c6be6-27ef-441c-a79e-6221533293b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-228335300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c2f9a0-1f2f-46e4-b694-5a0cff089922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:59Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be251964-370b-4373-9efa-16ceaae5bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be251964-370b-4373-9efa-16ceaae5bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c129ab1f-1d7b-42e0-bfb1-e31b7dc24beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c129ab1f-1d7b-42e0-bfb1-e31b7dc24beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c2f9a0-1f2f-46e4-b694-5a0cff089922', 'volume_name': 'volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411726ff-7f71-4778-9020-de48b337d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411726ff-7f71-4778-9020-de48b337d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9193854-dd1f-4b7e-a584-48fee213ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Volume a6c2f9a0-1f2f-46e4-b694-5a0cff089922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922', 'volume_size': 1} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-228335300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c2f9a0-1f2f-46e4-b694-5a0cff089922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:59Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Creating volume a6c2f9a0-1f2f-46e4-b694-5a0cff089922 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:58 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "cinder-quobyte-26e80c8f-5041-478a-8237-9cb130251037" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:58 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 1073741824 Jul 07 17:28:58 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-quobyte-26e80c8f-5041-478a-8237-9cb130251037" acquired by "delete_volume" :: waited 0.056s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:58 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.230s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:58 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Deleted volume successfully. Jul 07 17:28:59 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[35640bf8-10cd-441f-bb1b-727b23cd4cc0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2eeae1c-13ae-44c1-a4e3-be599f4d86ae tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-78bc3069-aed5-40ec-a133-4adf4c140d14-delete_volume" released by "delete_volume" :: held 4.093s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:59 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 Jul 07 17:28:59 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:00 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037" returned: 0 in 1.013s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:00 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037 Jul 07 17:29:00 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:00 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 1073741824" returned: 0 in 1.222s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:00 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 Jul 07 17:29:00 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:01 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-26e80c8f-5041-478a-8237-9cb130251037" returned: 0 in 1.398s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-quobyte-26e80c8f-5041-478a-8237-9cb130251037" released by "delete_volume" :: held 2.488s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:01 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" returned: 0 in 1.312s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] <== create_volume: return (2611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.613s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9193854-dd1f-4b7e-a584-48fee213ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8a2c05-315b-4e85-b8c2-53c4f50f0552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Volume volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 (a6c2f9a0-1f2f-46e4-b694-5a0cff089922): created successfully Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8a2c05-315b-4e85-b8c2-53c4f50f0552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (9678993b-b306-4373-8b63-75b9fe2f7a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Created reservations ['b1ac8368-63a7-4eee-8723-c91a7941a130', '23a257c1-fda3-47da-9767-f72a0dcfb0b4', 'c73d8e47-3c0e-454a-bbe7-06944059d78d', '38c085ea-ae53-4556-8d23-e0adfc22c8c6'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9ca73495-398b-4766-a715-5a0808f5a8a2 tempest-VolumesActionsTest-1492111031 None] Created volume successfully. Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:01 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:01 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7d8a17ae-9999-4d0d-a2fd-1618f99df4b0 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" by "attach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7d8a17ae-9999-4d0d-a2fd-1618f99df4b0 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" acquired by "attach_volume" :: waited 0.076s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7d8a17ae-9999-4d0d-a2fd-1618f99df4b0 tempest-VolumesActionsTest-1492111031 None] Attaching volume a6c2f9a0-1f2f-46e4-b694-5a0cff089922 to instance 1a9d2083-ed6a-4596-b5b8-21766cbc92ed at mountpoint /dev/vdb on host None. Jul 07 17:29:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7d8a17ae-9999-4d0d-a2fd-1618f99df4b0 tempest-VolumesActionsTest-1492111031 None] Attach volume completed successfully. Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7d8a17ae-9999-4d0d-a2fd-1618f99df4b0 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" released by "attach_volume" :: held 0.267s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "cinder-06ecf577-7665-4cdc-b34d-f83275d4ad17-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-06ecf577-7665-4cdc-b34d-f83275d4ad17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "cinder-quobyte-06ecf577-7665-4cdc-b34d-f83275d4ad17" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-quobyte-06ecf577-7665-4cdc-b34d-f83275d4ad17" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566c94e-c142-454d-ad4a-fadae80b4f16]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:02 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 Jul 07 17:29:02 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:03 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ffc484c6-b2a6-4116-b929-3f843d3121b6 tempest-VolumesActionsTest-150403925 None] Terminate volume connection completed successfully. Jul 07 17:29:03 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.819s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:03 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:03 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Deleted volume successfully. Jul 07 17:29:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1a2cd38-1e18-45be-b0c6-07de9c56918b tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-26e80c8f-5041-478a-8237-9cb130251037-delete_volume" released by "delete_volume" :: held 4.994s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ffc484c6-b2a6-4116-b929-3f843d3121b6 tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-detach_volume" by "detach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ffc484c6-b2a6-4116-b929-3f843d3121b6 tempest-VolumesActionsTest-150403925 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ffc484c6-b2a6-4116-b929-3f843d3121b6 tempest-VolumesActionsTest-150403925 None] Detaching volume a6c2f9a0-1f2f-46e4-b694-5a0cff089922 from instance 1a9d2083-ed6a-4596-b5b8-21766cbc92ed. Jul 07 17:29:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ffc484c6-b2a6-4116-b929-3f843d3121b6 tempest-VolumesActionsTest-150403925 None] Detach volume completed successfully. Jul 07 17:29:04 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17" returned: 0 in 1.561s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ffc484c6-b2a6-4116-b929-3f843d3121b6 tempest-VolumesActionsTest-150403925 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-detach_volume" released by "detach_volume" :: held 0.207s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:04 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17 Jul 07 17:29:04 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb61097-9bcb-4fbe-a6d7-b13e71e712e9 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-detach_volume" by "detach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb61097-9bcb-4fbe-a6d7-b13e71e712e9 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ceb61097-9bcb-4fbe-a6d7-b13e71e712e9 tempest-VolumesActionsTest-1492111031 None] Volume detach called, but volume not attached. Jul 07 17:29:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb61097-9bcb-4fbe-a6d7-b13e71e712e9 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:05 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-06ecf577-7665-4cdc-b34d-f83275d4ad17" returned: 0 in 1.169s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-quobyte-06ecf577-7665-4cdc-b34d-f83275d4ad17" released by "delete_volume" :: held 2.826s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Created reservations ['a107d029-3cbd-4e57-a8a9-c27f4ff88bf7', '2a27df6e-3b08-4071-8dbb-cf89ce1444d3', '4b8d3dc8-c1d9-4208-a716-7ad6327c8309', '3526d8a2-d116-45b5-823f-123b08612304'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e154d5d1-e223-4720-a367-96ec00ed3e64 req-f8728d20-1d18-4d86-8e0a-094ec0c79fdd tempest-AttachVolumeShelveTestJSON-1668771351 None] No connector for attachment eb9549e9-6ca9-4582-a309-410c9ef23a47; skipping storage backend terminate_connection call. {{(pid=87251) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e154d5d1-e223-4720-a367-96ec00ed3e64 req-f8728d20-1d18-4d86-8e0a-094ec0c79fdd tempest-AttachVolumeShelveTestJSON-1668771351 None] Deleting attachment eb9549e9-6ca9-4582-a309-410c9ef23a47. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:05 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:05 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "cinder-quobyte-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-quobyte-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" acquired by "delete_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9204bd-73b9-49e5-8c15-f98bf544a656]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:06 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.050s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Deleted volume successfully. Jul 07 17:29:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3cd0b82-6466-4763-b347-0bf7b29227c6 tempest-AttachVolumeTestJSON-1764762157 None] Lock "cinder-06ecf577-7665-4cdc-b34d-f83275d4ad17-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:06 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 Jul 07 17:29:06 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:08 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" returned: 0 in 1.590s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:08 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922 Jul 07 17:29:08 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" returned: 0 in 0.955s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:09 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-quobyte-a6c2f9a0-1f2f-46e4-b694-5a0cff089922" released by "delete_volume" :: held 2.735s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Created reservations ['b84cf798-18d8-432a-8ee1-0612c41c9eaa', 'b1e2daa1-25a7-4008-a6d7-f6789d217688', '30da8f73-47d3-403e-a6f7-37ab4a524713', '237ca997-9b91-493a-be4f-1a2e67748b02'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:09 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:09 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:10 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.866s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:10 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Deleted volume successfully. Jul 07 17:29:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-133f9648-d7ab-415d-a518-c5fac904e382 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-a6c2f9a0-1f2f-46e4-b694-5a0cff089922-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Acquiring lock "cinder-ee82393c-c59b-4157-aeb2-97d84452ac7d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Lock "cinder-ee82393c-c59b-4157-aeb2-97d84452ac7d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Acquiring lock "cinder-quobyte-ee82393c-c59b-4157-aeb2-97d84452ac7d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Lock "cinder-quobyte-ee82393c-c59b-4157-aeb2-97d84452ac7d" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd467883-d72b-45b1-9039-b600a383200c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:12 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d Jul 07 17:29:12 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:13 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d" returned: 0 in 1.207s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:13 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d Jul 07 17:29:13 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:14 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ee82393c-c59b-4157-aeb2-97d84452ac7d" returned: 0 in 0.930s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Lock "cinder-quobyte-ee82393c-c59b-4157-aeb2-97d84452ac7d" released by "delete_volume" :: held 2.209s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Created reservations ['ec1e6827-9f3b-44de-8f5e-1b73779adf37', 'a3c4121b-745f-4ff7-bf6c-fb9c9cb08187', '6b54f55b-bd11-401b-8321-50ba3772b0d9', 'f3c48d08-f11c-4bda-8777-fc52b31bc46d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:14 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:14 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:15 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.805s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:15 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:15 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Deleted volume successfully. Jul 07 17:29:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2d252696-e11b-41e5-8113-003a51a033d2 tempest-VolumesNegativeTest-1796789558 None] Lock "cinder-ee82393c-c59b-4157-aeb2-97d84452ac7d-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-436da6d8-7359-4da6-a974-ec1fdffa2ba9 tempest-BackendsCapabilitiesAdminTestsJSON-1442811388 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540245056152, 'free_capacity_gb': 1775.7540245056152, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87251) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:29:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ac0db64c-4ab6-4437-aaee-41f0feb27ddc tempest-BackendsCapabilitiesAdminTestsJSON-1442811388 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540245056152, 'free_capacity_gb': 1775.7540245056152, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87251) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (d22d9af1-a991-4061-906f-1994324febd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75204e96-d0f4-4a99-b6bc-d191fdc0310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75204e96-d0f4-4a99-b6bc-d191fdc0310b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-753182072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:20Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33f84f-0b49-47c1-8a30-62af62fb70bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33f84f-0b49-47c1-8a30-62af62fb70bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0ca545-1c36-4527-8da6-accd142f5356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0ca545-1c36-4527-8da6-accd142f5356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f', 'volume_name': 'volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8d622c-0b3d-44e5-8289-47fb1acfcc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8d622c-0b3d-44e5-8289-47fb1acfcc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb8e22d-cc24-4062-b269-6fa582339d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:20 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Volume 7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f', 'volume_size': 1} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-753182072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:20Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Creating volume 7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:20 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:29:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:20 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f 1073741824 Jul 07 17:29:20 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:21 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f 1073741824" returned: 0 in 1.149s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:21 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f Jul 07 17:29:21 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:22 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb8e22d-cc24-4062-b269-6fa582339d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453758e9-eaa9-4806-8031-2b0d319fdae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:22 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Volume volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f (7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f): created successfully Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453758e9-eaa9-4806-8031-2b0d319fdae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (d22d9af1-a991-4061-906f-1994324febd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b96d054e-0e96-4816-bcea-1d29013f6b94 tempest-VolumesActionsTest-1492111031 None] Created volume successfully. Jul 07 17:29:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Lock "cinder-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-quobyte-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa31ca6-565d-4da5-a94a-3e52be56a790]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:24 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f Jul 07 17:29:24 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:25 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f" returned: 0 in 1.103s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:25 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f Jul 07 17:29:25 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:26 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f" returned: 0 in 1.059s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f" released by "delete_volume" :: held 2.265s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Created reservations ['60986259-5f05-42c3-83de-98a66354e01a', '578198ee-c330-4fef-b5f5-d3afffcf9c88', '8a7cad84-0469-4cfc-b369-98382b7619b3', 'fde49143-8cf8-40e3-8d2a-073df94a3792'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:26 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:26 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:27 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.142s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:27 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Deleted volume successfully. Jul 07 17:29:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa63a8a4-c19f-4e72-b15a-8c9c7933e92d tempest-VolumesActionsTest-150403925 None] Lock "cinder-7b3ca518-e5d6-434d-a7b5-8f5b40c5d61f-delete_volume" released by "delete_volume" :: held 3.782s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (8b7c8c2d-99d0-4235-8f4e-c63255cce439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35d8346-0e44-4a13-b2d2-5010af435594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35d8346-0e44-4a13-b2d2-5010af435594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1219344594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9bbc82-f473-462f-9eab-6fffb999d380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:28Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3ea301-1d81-4fbc-bb3c-b7938e14db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3ea301-1d81-4fbc-bb3c-b7938e14db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07179b86-b5cf-4313-af7c-a24ca638248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07179b86-b5cf-4313-af7c-a24ca638248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9bbc82-f473-462f-9eab-6fffb999d380', 'volume_name': 'volume-bd9bbc82-f473-462f-9eab-6fffb999d380', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52555679-db39-4c7f-b0b0-65bef8a7e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52555679-db39-4c7f-b0b0-65bef8a7e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601a75f9-11eb-4434-8c64-e463e1ef1d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:28 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Volume bd9bbc82-f473-462f-9eab-6fffb999d380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9bbc82-f473-462f-9eab-6fffb999d380', 'volume_size': 1} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1219344594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9bbc82-f473-462f-9eab-6fffb999d380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:28Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Creating volume bd9bbc82-f473-462f-9eab-6fffb999d380 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:28 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:29:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:28 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 1073741824 Jul 07 17:29:28 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:30 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 1073741824" returned: 0 in 1.666s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:30 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 Jul 07 17:29:30 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:31 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380" returned: 0 in 1.243s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] <== create_volume: return (2982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.986s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601a75f9-11eb-4434-8c64-e463e1ef1d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9bbc82-f473-462f-9eab-6fffb999d380', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05de450f-787c-4c5c-8bd3-fc45b1d42fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:31 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Volume volume-bd9bbc82-f473-462f-9eab-6fffb999d380 (bd9bbc82-f473-462f-9eab-6fffb999d380): created successfully Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05de450f-787c-4c5c-8bd3-fc45b1d42fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (8b7c8c2d-99d0-4235-8f4e-c63255cce439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-661ca979-982c-42d2-958f-36a2a3b99832 tempest-VolumesActionsTest-1492111031 None] Created volume successfully. Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-bd9bbc82-f473-462f-9eab-6fffb999d380-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Lock "cinder-bd9bbc82-f473-462f-9eab-6fffb999d380-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-quobyte-bd9bbc82-f473-462f-9eab-6fffb999d380" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-bd9bbc82-f473-462f-9eab-6fffb999d380" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae10a8-ca25-44a5-9c37-56c189a0fb5f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:32 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 Jul 07 17:29:32 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:32 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:32 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:33 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380" returned: 0 in 1.279s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:33 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380 Jul 07 17:29:33 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:33 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.052s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 8 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:29:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:29:34 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd9bbc82-f473-462f-9eab-6fffb999d380" returned: 0 in 1.062s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-bd9bbc82-f473-462f-9eab-6fffb999d380" released by "delete_volume" :: held 2.409s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Created reservations ['0533ccc3-9f0d-4677-95fc-133c17993992', '9d29f961-5c05-4f05-b10f-4a4455cfdedb', '630c887e-38d3-495a-9294-1125e692e5fd', '012c6dce-01f8-47de-8a5d-735de3bae3d2'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:34 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:34 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:36 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.279s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:36 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Deleted volume successfully. Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ec49e260-e604-4e77-9713-ab59e1cd6c0a tempest-VolumesActionsTest-150403925 None] Lock "cinder-bd9bbc82-f473-462f-9eab-6fffb999d380-delete_volume" released by "delete_volume" :: held 4.068s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (11f8a564-305f-491b-8428-ccf28d959641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef1ae1b-c51c-4e12-9e8f-29f9c768de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef1ae1b-c51c-4e12-9e8f-29f9c768de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848519987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:36Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d200d5d5-bf38-4cd0-850a-a52df6b308df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d200d5d5-bf38-4cd0-850a-a52df6b308df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5546a1fe-da7d-4dc2-aa85-65140eecee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5546a1fe-da7d-4dc2-aa85-65140eecee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db', 'volume_name': 'volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18d1222-3267-4f74-a120-36f8df02673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18d1222-3267-4f74-a120-36f8df02673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61b9e19-3ba1-4b15-aca2-16e8eb901786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:36 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Volume a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db', 'volume_size': 1} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848519987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:36Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Creating volume a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:36 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:29:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:36 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db 1073741824 Jul 07 17:29:36 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:37 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db 1073741824" returned: 0 in 1.307s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:37 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db Jul 07 17:29:37 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:38 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db" returned: 0 in 1.075s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61b9e19-3ba1-4b15-aca2-16e8eb901786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75256e3c-d33e-4930-bc70-15ab348e5428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:38 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Volume volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db (a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db): created successfully Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75256e3c-d33e-4930-bc70-15ab348e5428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (11f8a564-305f-491b-8428-ccf28d959641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f626043d-42a4-438e-9d70-f5151d01bd8a tempest-VolumesActionsTest-1492111031 None] Created volume successfully. Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Lock "cinder-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-quobyte-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c05dc-2e83-492f-b008-3d666cccc152]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:40 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db Jul 07 17:29:40 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:41 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db" returned: 0 in 1.220s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:41 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db Jul 07 17:29:41 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:42 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db" returned: 0 in 0.952s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db" released by "delete_volume" :: held 2.234s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Created reservations ['1fab23f2-9a20-454c-a46f-194f367e46b7', '9a08dcfa-b386-4186-b010-bbff8a1ddec8', 'f21ff58d-052e-45ea-9085-414cc6ba00ab', '42e9d991-dea6-4637-b24b-359e335b8bcf'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Flow 'volume_create_manager' (cef6260b-7a6b-4dac-a689-059318c019dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1ace70-ba33-45c4-8311-403e7c71c2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1ace70-ba33-45c4-8311-403e7c71c2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1269531478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f92c55-f0c1-4257-a89c-ee1d44fb1c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7061b1fca14d4b4eb5da8f4ad21b3bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:42Z,use_quota=True,user_id='51ac9711c6e843a09f32d5b5e06f840b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4079d289-2674-4078-9597-a1bd7dd6f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4079d289-2674-4078-9597-a1bd7dd6f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce94f20-15bd-4ba9-877d-6366e6ff72bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:42 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:42 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce94f20-15bd-4ba9-877d-6366e6ff72bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84f92c55-f0c1-4257-a89c-ee1d44fb1c16', 'volume_name': 'volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a103e72-ed63-4c74-8c6b-72b490e8be93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a103e72-ed63-4c74-8c6b-72b490e8be93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bbb71a-2126-4491-8060-e555ad084bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Volume 84f92c55-f0c1-4257-a89c-ee1d44fb1c16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:29:42 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Trying to clone 84f92c55-f0c1-4257-a89c-ee1d44fb1c16 from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:29:43 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:29:43 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Deleted volume successfully. Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e81dcc-87d2-480c-88ea-0cbf1d34f917]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-55f0b2f5-4217-4cb9-85b4-ee4aa711c1bd tempest-VolumesActionsTest-150403925 None] Lock "cinder-a6d0cc00-dcb7-4fa0-a3d7-62c09b8ad0db-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:43 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD Jul 07 17:29:43 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (33441520-2fc7-4314-8c10-497e7de8964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc50af-0450-47c0-a9fd-8b816e2b5240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc50af-0450-47c0-a9fd-8b816e2b5240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419838406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:44Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef82be7-5c21-47b2-a838-f72baaf3a7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef82be7-5c21-47b2-a838-f72baaf3a7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5b8600-f8ee-43be-af31-ace0707348ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5b8600-f8ee-43be-af31-ace0707348ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb', 'volume_name': 'volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132be387-aae0-400e-b457-a99f5f3ec73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132be387-aae0-400e-b457-a99f5f3ec73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b02fe09-1b4b-482c-b44c-56fde51b2b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Volume f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb', 'volume_size': 1} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419838406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:44Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Creating volume f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:44 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:44 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb 1073741824 Jul 07 17:29:44 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:44 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD" returned: 0 in 1.000s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 is fetched for user 51ac9711c6e843a09f32d5b5e06f840b. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd9e7b3-6f6a-4036-a905-f88005e0a8dd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:44 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD Jul 07 17:29:44 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:45 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb 1073741824" returned: 0 in 1.006s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:45 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb Jul 07 17:29:45 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:45 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:45 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb" returned: 0 in 0.694s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1269531478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f92c55-f0c1-4257-a89c-ee1d44fb1c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7061b1fca14d4b4eb5da8f4ad21b3bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:42Z,use_quota=True,user_id='51ac9711c6e843a09f32d5b5e06f840b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Creating volume 84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:45 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:45 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 1073741824 Jul 07 17:29:45 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b02fe09-1b4b-482c-b44c-56fde51b2b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac5f948-5a13-413e-b52c-22549673b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Volume volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb (f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb): created successfully Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac5f948-5a13-413e-b52c-22549673b553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (33441520-2fc7-4314-8c10-497e7de8964f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:45 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d3d7b884-6d89-4dd9-9b6c-e399fea66f73 tempest-VolumesActionsTest-1492111031 None] Created volume successfully. Jul 07 17:29:46 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 1073741824" returned: 0 in 0.977s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:46 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:46 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Lock "cinder-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Acquiring lock "cinder-quobyte-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da5644-cec3-4043-a1fd-4c9ef8b5fe47]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:47 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb Jul 07 17:29:47 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:47 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Attempting download of 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume 84f92c55-f0c1-4257-a89c-ee1d44fb1c16. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f64f0-6da5-4750-8c0a-20e54902ab45]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:47 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r Jul 07 17:29:47 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:48 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb" returned: 0 in 0.965s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:48 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb Jul 07 17:29:48 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:48 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r" returned: 0 in 1.043s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:48 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r Jul 07 17:29:48 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:49 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Lock "cinder-quobyte-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb" released by "delete_volume" :: held 1.797s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Created reservations ['2c31e892-5630-4b69-ad71-9c221c5a93a2', '419f511d-55cf-47c3-a604-522177a575de', '548892d2-84c1-4d25-9920-bba81f78d869', '4b386ab2-b57f-4191-8960-1de531c81fb2'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:49 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:49 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:49 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r" returned: 1 in 0.993s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_lz2s_b2r' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf293e79-a09a-4d23-8e92-33552925092b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:49 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD Jul 07 17:29:49 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (c834aca5-028c-47dd-b053-3177935eb785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15be073-148b-4579-8e79-c8a174843f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15be073-148b-4579-8e79-c8a174843f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-390094312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49055971-ca60-45b1-96f8-e89bf194a955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:50Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb16d65-4a7e-406e-9473-38a67f6053c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb16d65-4a7e-406e-9473-38a67f6053c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687f01ab-9520-4829-bd25-0a300a6e3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687f01ab-9520-4829-bd25-0a300a6e3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49055971-ca60-45b1-96f8-e89bf194a955', 'volume_name': 'volume-49055971-ca60-45b1-96f8-e89bf194a955', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d07355e-06a6-4273-bdd4-491ba69852ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d07355e-06a6-4273-bdd4-491ba69852ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa913c2-1851-45f8-82c4-e85e08e0f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Volume 49055971-ca60-45b1-96f8-e89bf194a955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49055971-ca60-45b1-96f8-e89bf194a955', 'volume_size': 1} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-390094312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49055971-ca60-45b1-96f8-e89bf194a955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8450967f0cbc4ce48956b8fa9ac1cb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:50Z,use_quota=True,user_id='ddc50e1e97ef4805a1d1bbc641f9d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Creating volume 49055971-ca60-45b1-96f8-e89bf194a955 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:50 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:50 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.097s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Deleted volume successfully. Jul 07 17:29:50 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 1073741824 Jul 07 17:29:50 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-93d10232-59de-415d-bc91-5a20554bd607 tempest-VolumesActionsTest-150403925 None] Lock "cinder-f5d63bfc-d2dd-4438-b1e3-fedbe947d4eb-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:50 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 was qcow2, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:29:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:50 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:50 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:51 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 1073741824" returned: 0 in 0.999s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:51 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 Jul 07 17:29:51 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:52 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955" returned: 0 in 0.801s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa913c2-1851-45f8-82c4-e85e08e0f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49055971-ca60-45b1-96f8-e89bf194a955', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ffc755-42c8-4684-9988-eba502eea574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:52 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Volume volume-49055971-ca60-45b1-96f8-e89bf194a955 (49055971-ca60-45b1-96f8-e89bf194a955): created successfully Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ffc755-42c8-4684-9988-eba502eea574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Flow 'volume_create_manager' (c834aca5-028c-47dd-b053-3177935eb785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:52 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-25f281a5-9a3e-41b9-b519-df612b6c5be1 tempest-VolumesActionsTest-1492111031 None] Created volume successfully. Jul 07 17:29:53 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 0 in 2.596s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:53 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_g18vqwnjdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:29:53 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Converted 112.00 MB image at 43.12 MB/s Jul 07 17:29:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:53 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 1G Jul 07 17:29:53 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:54 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 1G" returned: 0 in 0.906s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b688a-3e2b-43e1-bb92-ec7229ae10a7]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "cinder-49055971-ca60-45b1-96f8-e89bf194a955-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-49055971-ca60-45b1-96f8-e89bf194a955-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=98,cinder:SELECT=65,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=73,cinder:INSERT=21,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "cinder-quobyte-49055971-ca60-45b1-96f8-e89bf194a955" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-quobyte-49055971-ca60-45b1-96f8-e89bf194a955" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:54 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:54 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9895be17-7bef-4c42-86f9-e1063d9e1804]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:54 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 Jul 07 17:29:54 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:55 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 0 in 0.970s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:55 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:55 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:55 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955" returned: 0 in 0.993s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:55 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955 Jul 07 17:29:55 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:56 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 1 in 0.873s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Downloaded image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume 84f92c55-f0c1-4257-a89c-ee1d44fb1c16 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 for user 51ac9711c6e843a09f32d5b5e06f840b is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Marking volume 84f92c55-f0c1-4257-a89c-ee1d44fb1c16 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Copying metadata from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 to 84f92c55-f0c1-4257-a89c-ee1d44fb1c16. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Creating volume glance metadata for volume 84f92c55-f0c1-4257-a89c-ee1d44fb1c16 backed by image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:29:56 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-49055971-ca60-45b1-96f8-e89bf194a955" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bbb71a-2126-4491-8060-e555ad084bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e705282-eac0-4d5c-90bb-29b3340ca42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-quobyte-49055971-ca60-45b1-96f8-e89bf194a955" released by "delete_volume" :: held 1.848s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:56 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Volume volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 (84f92c55-f0c1-4257-a89c-ee1d44fb1c16): created successfully Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e705282-eac0-4d5c-90bb-29b3340ca42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Flow 'volume_create_manager' (cef6260b-7a6b-4dac-a689-059318c019dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ba263a24-5aa6-4cba-98a2-2767ab0760f9 tempest-VolumesImageMetadata-410325372 None] Created volume successfully. Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Created reservations ['f004a65f-caa2-4f1b-93a6-59fc04b9f62d', 'a4dba106-fe6c-4828-9523-f6f0cace35cd', '206c57c8-0291-4bbe-b762-d1155f6489ee', '7164533d-0630-43e1-814f-82032ac8c937'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:56 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:29:56 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:57 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.747s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Deleted volume successfully. Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8520a820-1a26-420e-8867-9b4d0d1d5172 tempest-VolumesActionsTest-1492111031 None] Lock "cinder-49055971-ca60-45b1-96f8-e89bf194a955-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Acquiring lock "cinder-84f92c55-f0c1-4257-a89c-ee1d44fb1c16-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Lock "cinder-84f92c55-f0c1-4257-a89c-ee1d44fb1c16-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Acquiring lock "cinder-quobyte-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Lock "cinder-quobyte-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba3c41a-ba87-47a3-ac08-afd0dbb63557]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:58 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:58 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:58 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 0 in 0.877s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:59 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:59 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:59 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 1 in 1.039s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:29:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:59 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16 Jul 07 17:29:59 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:00 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" returned: 0 in 0.842s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Lock "cinder-quobyte-84f92c55-f0c1-4257-a89c-ee1d44fb1c16" released by "delete_volume" :: held 2.843s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Created reservations ['f9ab0bf6-1c1b-47a6-a236-43982e7ea21d', '2dde1163-5869-4071-8c23-3f4930589bf8', '2ca4e12b-6ede-48f8-897d-afbb793ebe80', '26921ae2-6622-4607-8480-e8295724b292'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:00 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:00 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Acquiring lock "cinder-14a5d944-1789-4708-92c6-1d55a05407bd-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "cinder-14a5d944-1789-4708-92c6-1d55a05407bd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Acquiring lock "cinder-quobyte-14a5d944-1789-4708-92c6-1d55a05407bd" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "cinder-quobyte-14a5d944-1789-4708-92c6-1d55a05407bd" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:01 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.055s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:01 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Deleted volume successfully. Jul 07 17:30:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da259d7-bb9b-4ef3-aee9-c8bf1998cde4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f61db61e-0438-4555-896a-4601aac5d519 tempest-VolumesImageMetadata-410325372 None] Lock "cinder-84f92c55-f0c1-4257-a89c-ee1d44fb1c16-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:02 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd Jul 07 17:30:02 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:03 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd" returned: 0 in 1.022s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:03 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd Jul 07 17:30:03 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:03 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-14a5d944-1789-4708-92c6-1d55a05407bd" returned: 0 in 0.948s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "cinder-quobyte-14a5d944-1789-4708-92c6-1d55a05407bd" released by "delete_volume" :: held 2.074s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Created reservations ['74d6a399-64e3-4ccf-b65e-640d384a6f20', 'e6c28a22-e3ca-48e6-967c-257dbfe017b9', 'ed1d1c74-954a-45ad-a151-79a317120b22', '26aaa772-4480-4fd1-ae69-237476a333a3'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:04 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:04 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:05 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.833s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:05 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Deleted volume successfully. Jul 07 17:30:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f874ea45-91db-4507-a534-610463b2f5da tempest-AttachVolumeShelveTestJSON-1668771351 None] Lock "cinder-14a5d944-1789-4708-92c6-1d55a05407bd-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Flow 'volume_create_manager' (377099b7-8d17-4bf1-9dec-ca614f7249a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a47fc5-cfdd-440a-943f-1c81021cf910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a47fc5-cfdd-440a-943f-1c81021cf910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2133575648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1016c48d-8558-4fd3-8ef6-292ec613efc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aab2afdabe8487b830f27793850368c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:06Z,use_quota=True,user_id='ce6fa1a107b248c18126c84d57f827c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57ca9cb-243e-4f32-aeba-4fa8fe9261bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57ca9cb-243e-4f32-aeba-4fa8fe9261bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99055548-7840-4273-a876-65eecc98a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99055548-7840-4273-a876-65eecc98a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1016c48d-8558-4fd3-8ef6-292ec613efc7', 'volume_name': 'volume-1016c48d-8558-4fd3-8ef6-292ec613efc7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e10933-9f6e-4860-995b-6e26ed069168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e10933-9f6e-4860-995b-6e26ed069168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f57a24c-e575-431b-a92a-c96a50736721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:06 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Volume 1016c48d-8558-4fd3-8ef6-292ec613efc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1016c48d-8558-4fd3-8ef6-292ec613efc7', 'volume_size': 1} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2133575648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1016c48d-8558-4fd3-8ef6-292ec613efc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aab2afdabe8487b830f27793850368c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:06Z,use_quota=True,user_id='ce6fa1a107b248c18126c84d57f827c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Creating volume 1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:06 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:06 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 1073741824 Jul 07 17:30:06 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:07 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 1073741824" returned: 0 in 1.249s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:07 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 Jul 07 17:30:07 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:08 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7" returned: 0 in 1.295s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] <== create_volume: return (2596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.600s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f57a24c-e575-431b-a92a-c96a50736721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1016c48d-8558-4fd3-8ef6-292ec613efc7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b0013c-efbe-4e37-861c-cd9aefa2bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Volume volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 (1016c48d-8558-4fd3-8ef6-292ec613efc7): created successfully Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b0013c-efbe-4e37-861c-cd9aefa2bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Flow 'volume_create_manager' (377099b7-8d17-4bf1-9dec-ca614f7249a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1702ca02-514a-4546-b792-f96ace6cf2a2 tempest-SnapshotMetadataTestJSON-1850452772 None] Created volume successfully. Jul 07 17:30:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Creating offline snapshot ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 of volume 1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c4b73-81d7-4d2e-9c87-50850d9583f4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:10 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 Jul 07 17:30:10 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:11 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7" returned: 0 in 1.092s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:11 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 1G Jul 07 17:30:11 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:12 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 1G" returned: 0 in 1.469s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:12 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 Jul 07 17:30:12 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Flow 'volume_create_manager' (949685f8-df01-4220-80d8-37bf5ce1ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eebee0a-e29a-4948-ab7a-570c6864754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eebee0a-e29a-4948-ab7a-570c6864754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-579623916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a42177-531b-4b5f-b2e3-af763f767bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1af86bba1b499e9817e92a17c1788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:13Z,use_quota=True,user_id='6a65ee8237cc42ac9326cf1a2601e947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c1df35-9869-421c-842b-bfc09189401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c1df35-9869-421c-842b-bfc09189401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81da2fa3-7365-49b5-a1a5-12178852242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81da2fa3-7365-49b5-a1a5-12178852242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a42177-531b-4b5f-b2e3-af763f767bc5', 'volume_name': 'volume-c4a42177-531b-4b5f-b2e3-af763f767bc5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eec9f7-64ae-4b5a-90dd-8853eaae246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eec9f7-64ae-4b5a-90dd-8853eaae246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddde854-7874-4397-8f51-0d946fe31579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Volume c4a42177-531b-4b5f-b2e3-af763f767bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a42177-531b-4b5f-b2e3-af763f767bc5', 'volume_size': 1} Jul 07 17:30:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:13 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" returned: 0 in 1.158s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:13 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 is being set with open permissions: ugo+rw Jul 07 17:30:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:13 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 Jul 07 17:30:13 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:14 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" returned: 0 in 0.747s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:14 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info Jul 07 17:30:14 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:15 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info" returned: 0 in 0.818s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:15 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info is being set with open permissions: ugo+rw Jul 07 17:30:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:15 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info Jul 07 17:30:15 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:16 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.info" returned: 0 in 0.996s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.433s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.445s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-579623916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a42177-531b-4b5f-b2e3-af763f767bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1af86bba1b499e9817e92a17c1788f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:13Z,use_quota=True,user_id='6a65ee8237cc42ac9326cf1a2601e947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Creating volume c4a42177-531b-4b5f-b2e3-af763f767bc5 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:16 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:16 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 1073741824 Jul 07 17:30:16 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9f6b1890-86db-4f70-936e-4268f701b0ba tempest-SnapshotMetadataTestJSON-1850452772 None] Create snapshot completed successfully Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Flow 'volume_create_manager' (8362d97b-dd17-4080-b095-5d5c063bffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5956923d-6f18-482b-800f-0c8b606df563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5956923d-6f18-482b-800f-0c8b606df563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-733165530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5617642f-dd28-436f-9c55-adf04bacc059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee109d28634cde81dbc2f77e0f3858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:17Z,use_quota=True,user_id='829a41c4344e4518845eb1c3fd8dcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45db5564-e6bc-4a6d-80cd-22d6bb8bbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45db5564-e6bc-4a6d-80cd-22d6bb8bbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d954e9-8d12-486e-a3ef-98e8a322f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d954e9-8d12-486e-a3ef-98e8a322f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5617642f-dd28-436f-9c55-adf04bacc059', 'volume_name': 'volume-5617642f-dd28-436f-9c55-adf04bacc059', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d6d05b-e233-499d-a86f-975e6cdeae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d6d05b-e233-499d-a86f-975e6cdeae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1becf52-7f2f-4fa9-b9d7-ca1a21c5fa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Volume 5617642f-dd28-436f-9c55-adf04bacc059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5617642f-dd28-436f-9c55-adf04bacc059', 'volume_size': 1} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 1073741824" returned: 0 in 1.343s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:17 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 Jul 07 17:30:17 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "cinder-ca07bab0-dd9a-4e2e-8f62-d784fb146ad7-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-ca07bab0-dd9a-4e2e-8f62-d784fb146ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "cinder-quobyte-1016c48d-8558-4fd3-8ef6-292ec613efc7" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-quobyte-1016c48d-8558-4fd3-8ef6-292ec613efc7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "cinder-quobyte-ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-quobyte-ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Deleting offline snapshot ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 of volume 1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] snapshot_file for this snap is: volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5044cb15-1d9c-4a59-8043-7af78df04ea5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:18 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5" returned: 0 in 0.984s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-733165530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5617642f-dd28-436f-9c55-adf04bacc059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee109d28634cde81dbc2f77e0f3858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:17Z,use_quota=True,user_id='829a41c4344e4518845eb1c3fd8dcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Creating volume 5617642f-dd28-436f-9c55-adf04bacc059 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:18 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddde854-7874-4397-8f51-0d946fe31579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a42177-531b-4b5f-b2e3-af763f767bc5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:18 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 1073741824 Jul 07 17:30:18 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:18 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 Jul 07 17:30:18 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5259f1c0-af72-4fd5-9542-f553639b141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Volume volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 (c4a42177-531b-4b5f-b2e3-af763f767bc5): created successfully Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5259f1c0-af72-4fd5-9542-f553639b141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Flow 'volume_create_manager' (949685f8-df01-4220-80d8-37bf5ce1ca15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0ac01069-47b6-4d64-82be-5395f0ef16ae tempest-TestMinimumBasicScenario-427956041 None] Created volume successfully. Jul 07 17:30:19 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" returned: 0 in 1.144s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1016c48d-8558-4fd3-8ef6-292ec613efc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:19 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d8f3c-43d1-4f9c-9d67-b4e3f68d1675]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:19 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 Jul 07 17:30:19 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 1073741824" returned: 0 in 1.374s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:20 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 Jul 07 17:30:20 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7" returned: 0 in 0.860s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:20 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 Jul 07 17:30:20 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059" returned: 0 in 0.731s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1becf52-7f2f-4fa9-b9d7-ca1a21c5fa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5617642f-dd28-436f-9c55-adf04bacc059', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c984ae8-3ede-458b-8d50-0810c72546c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:20 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Volume volume-5617642f-dd28-436f-9c55-adf04bacc059 (5617642f-dd28-436f-9c55-adf04bacc059): created successfully Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c984ae8-3ede-458b-8d50-0810c72546c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Flow 'volume_create_manager' (8362d97b-dd17-4080-b095-5d5c063bffbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0c9d0136-5ef6-4b56-9eca-052291004a55 tempest-VolumesListAdminTestJSON-604109140 None] Created volume successfully. Jul 07 17:30:21 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7 Jul 07 17:30:21 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-223a0111-f580-4b9f-9e6a-eafe3b768b4a tempest-GroupSnapshotsV319Test-1837097450 None] Group tempest-GroupSnapshotsV319Test-Group-1326285025: creating Jul 07 17:30:22 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7.ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" returned: 0 in 0.736s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-223a0111-f580-4b9f-9e6a-eafe3b768b4a tempest-GroupSnapshotsV319Test-1837097450 None] Group tempest-GroupSnapshotsV319Test-Group-1326285025: created successfully Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-quobyte-ca07bab0-dd9a-4e2e-8f62-d784fb146ad7" released by "_delete_snapshot" :: held 3.703s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-223a0111-f580-4b9f-9e6a-eafe3b768b4a tempest-GroupSnapshotsV319Test-1837097450 None] Create group completed successfully. Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-quobyte-1016c48d-8558-4fd3-8ef6-292ec613efc7" released by "delete_snapshot" :: held 3.749s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Created reservations ['46483575-66c1-46ed-b740-7bb69494e289', '09a0c666-78c0-4cdb-9c05-d869ceb91b23', '02b840f7-e316-48f9-bd95-51baab6c2c58', '2a75837d-f348-4225-93c4-b5a1fa4b7a94'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Flow 'volume_create_manager' (da060d75-0798-4f7b-b8aa-cf34b07fff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39840300-f22c-4965-8ce8-61c236355601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Delete snapshot completed successfully. Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39840300-f22c-4965-8ce8-61c236355601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-118269003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b652798-8ee4-4f94-826d-8dc7d58e82ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee109d28634cde81dbc2f77e0f3858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:22Z,use_quota=True,user_id='829a41c4344e4518845eb1c3fd8dcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5c7f71-c584-494e-9e7d-0eba7858d2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5c7f71-c584-494e-9e7d-0eba7858d2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d835c9b7-5b60-491d-9fa0-1edfb0beca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d835c9b7-5b60-491d-9fa0-1edfb0beca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b652798-8ee4-4f94-826d-8dc7d58e82ad', 'volume_name': 'volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a727992f-586d-437e-ab88-89285cda4861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a727992f-586d-437e-ab88-89285cda4861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66ef4ad-3b09-4953-9330-4da7931588e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:22 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Volume 1b652798-8ee4-4f94-826d-8dc7d58e82ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad', 'volume_size': 1} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-118269003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b652798-8ee4-4f94-826d-8dc7d58e82ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee109d28634cde81dbc2f77e0f3858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:22Z,use_quota=True,user_id='829a41c4344e4518845eb1c3fd8dcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Creating volume 1b652798-8ee4-4f94-826d-8dc7d58e82ad {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:22 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fcafc125-9445-492c-bdf8-620c4d8fe696 tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-ca07bab0-dd9a-4e2e-8f62-d784fb146ad7-delete_snapshot" released by "delete_snapshot" :: held 4.038s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:22 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad 1073741824 Jul 07 17:30:22 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Flow 'volume_create_manager' (7c96fa30-8481-401b-9756-1f308c7aa480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13a93ed-dae3-4502-b786-918b183825bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13a93ed-dae3-4502-b786-918b183825bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528421933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b156ccdc-6581-4c91-a15d-feaf9d4c90fe,host='devstack@QuobyteHD#QuobyteHD',id=9bf84de9-ffa1-4772-bd41-f7ebf34549e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c8e91c93494ee79c115587c5292293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:23Z,use_quota=True,user_id='020a8214526f4447a38943af465e2818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42df5e48-2f4a-463b-a4bc-3eaaee35914b),volume_type_id=42df5e48-2f4a-463b-a4bc-3eaaee35914b)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b6f592-0d1f-479f-a96a-682cd8c05a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b6f592-0d1f-479f-a96a-682cd8c05a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34279c12-0bdf-4d47-b939-409e92b456d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34279c12-0bdf-4d47-b939-409e92b456d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf84de9-ffa1-4772-bd41-f7ebf34549e1', 'volume_name': 'volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288d4d51-d847-4da6-b564-c7d2d029790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288d4d51-d847-4da6-b564-c7d2d029790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f72749-cdbf-471b-8859-5f9c85b6fcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:23 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Volume 9bf84de9-ffa1-4772-bd41-f7ebf34549e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1', 'volume_size': 1} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "cinder-1016c48d-8558-4fd3-8ef6-292ec613efc7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-1016c48d-8558-4fd3-8ef6-292ec613efc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "cinder-quobyte-1016c48d-8558-4fd3-8ef6-292ec613efc7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-quobyte-1016c48d-8558-4fd3-8ef6-292ec613efc7" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc9e09a-6334-4bad-9e86-79fd5e2031cd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:23 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 Jul 07 17:30:23 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:23 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad 1073741824" returned: 0 in 0.965s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad Jul 07 17:30:23 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:23 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7" returned: 0 in 0.761s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7 Jul 07 17:30:23 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:24 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad" returned: 0 in 0.726s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b156ccdc-6581-4c91-a15d-feaf9d4c90fe,created_at=2026-07-07T15:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528421933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b156ccdc-6581-4c91-a15d-feaf9d4c90fe,host='devstack@QuobyteHD#QuobyteHD',id=9bf84de9-ffa1-4772-bd41-f7ebf34549e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c8e91c93494ee79c115587c5292293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:23Z,use_quota=True,user_id='020a8214526f4447a38943af465e2818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42df5e48-2f4a-463b-a4bc-3eaaee35914b),volume_type_id=42df5e48-2f4a-463b-a4bc-3eaaee35914b)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Creating volume 9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:24 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:24 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 1073741824 Jul 07 17:30:24 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66ef4ad-3b09-4953-9330-4da7931588e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c71af9-4de3-43a5-870c-4d2a3ed1ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:24 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Volume volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad (1b652798-8ee4-4f94-826d-8dc7d58e82ad): created successfully Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c71af9-4de3-43a5-870c-4d2a3ed1ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Flow 'volume_create_manager' (da060d75-0798-4f7b-b8aa-cf34b07fff5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6a664067-cd8d-42a7-aae5-9cbb61486489 tempest-VolumesListAdminTestJSON-604109140 None] Created volume successfully. Jul 07 17:30:24 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1016c48d-8558-4fd3-8ef6-292ec613efc7" returned: 0 in 0.691s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-quobyte-1016c48d-8558-4fd3-8ef6-292ec613efc7" released by "delete_volume" :: held 1.516s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Created reservations ['3491f44b-2482-42cf-bd59-5e49ed5cd0ff', 'f30d3afd-fa40-45b2-8414-7c68f8d8d8e9', '2cec8d7b-945d-4954-8064-228ed228fe11', '6a15a148-bae0-4547-8a15-809587e53760'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:24 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:24 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Flow 'volume_create_manager' (6dadae33-6bd4-4239-aff2-1d1d45665d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f71c29-b4a7-4fc2-b41c-cc550afbbfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f71c29-b4a7-4fc2-b41c-cc550afbbfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1634822711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3397c184-9d9a-493c-82eb-eaec3aca059b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee109d28634cde81dbc2f77e0f3858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:25Z,use_quota=True,user_id='829a41c4344e4518845eb1c3fd8dcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbde60a9-0877-438d-8072-6125f4525a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbde60a9-0877-438d-8072-6125f4525a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ad47db-eede-4ba7-af29-f6c47a286ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ad47db-eede-4ba7-af29-f6c47a286ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3397c184-9d9a-493c-82eb-eaec3aca059b', 'volume_name': 'volume-3397c184-9d9a-493c-82eb-eaec3aca059b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c263ea-5ecf-4f72-b5ec-16391aa561d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c263ea-5ecf-4f72-b5ec-16391aa561d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0416a390-7c64-4713-a37a-90d4d11d10aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:25 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Volume 3397c184-9d9a-493c-82eb-eaec3aca059b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3397c184-9d9a-493c-82eb-eaec3aca059b', 'volume_size': 1} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:25 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 1073741824" returned: 0 in 0.986s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:25 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 Jul 07 17:30:25 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.748s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:25 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Deleted volume successfully. Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f088cb3b-a645-4117-94bd-746c44d5d50f tempest-SnapshotMetadataTestJSON-1850452772 None] Lock "cinder-1016c48d-8558-4fd3-8ef6-292ec613efc7-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:25 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" returned: 0 in 0.706s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.756s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f72749-cdbf-471b-8859-5f9c85b6fcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4567fd-77dc-45d2-8af7-41a58f4474e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1090af7f-0e40-4e8d-b6ec-1622249d2343]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Volume volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 (9bf84de9-ffa1-4772-bd41-f7ebf34549e1): created successfully Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4567fd-77dc-45d2-8af7-41a58f4474e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Flow 'volume_create_manager' (7c96fa30-8481-401b-9756-1f308c7aa480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-33ef57fd-b320-4f9b-8065-f8ab116ae927 tempest-GroupSnapshotsV319Test-1837097450 None] Created volume successfully. Jul 07 17:30:26 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 Jul 07 17:30:26 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] GroupSnapshot 1581226e-aaee-4ac3-ba9c-eee30c2abd8f: creating. Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Group snapshot 1581226e-aaee-4ac3-ba9c-eee30c2abd8f: creating. {{(pid=87251) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:30:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:26 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5" returned: 0 in 0.977s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1634822711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3397c184-9d9a-493c-82eb-eaec3aca059b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ee109d28634cde81dbc2f77e0f3858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:25Z,use_quota=True,user_id='829a41c4344e4518845eb1c3fd8dcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Creating volume 3397c184-9d9a-493c-82eb-eaec3aca059b {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:27 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:27 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b 1073741824 Jul 07 17:30:27 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-c4a42177-531b-4b5f-b2e3-af763f767bc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ad3c7b4-d07f-4b60-9903-5fa77a093073', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:30:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-e13be583-e140-4a39-b6e8-9f76abca5ed8 req-bf8b5fa0-f1f5-4d5e-b091-c4fe9db984eb tempest-TestMinimumBasicScenario-427956041 None] attachment_update completed successfully. Jul 07 17:30:28 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b 1073741824" returned: 0 in 1.110s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:28 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b Jul 07 17:30:28 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:28 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.032s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Creating offline snapshot f05d934e-15d7-43db-8ddb-dccc6f0b6d54 of volume 9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0416a390-7c64-4713-a37a-90d4d11d10aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3397c184-9d9a-493c-82eb-eaec3aca059b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8fc52-9cc7-430d-ac68-247117757070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdb70d4-7fa8-4ba0-ae58-9da2e8b03930]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:28 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Volume volume-3397c184-9d9a-493c-82eb-eaec3aca059b (3397c184-9d9a-493c-82eb-eaec3aca059b): created successfully Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8fc52-9cc7-430d-ac68-247117757070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Flow 'volume_create_manager' (6dadae33-6bd4-4239-aff2-1d1d45665d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-29abdb3b-9a37-494c-ba51-6d73611b2c97 tempest-VolumesListAdminTestJSON-604109140 None] Created volume successfully. Jul 07 17:30:29 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 Jul 07 17:30:29 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:29 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" returned: 0 in 0.883s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:29 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 1G Jul 07 17:30:29 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Flow 'volume_create_manager' (503c30ad-16ca-4cfa-80bd-81372c9378a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6a40e-6372-4195-aa5b-190775a08a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6a40e-6372-4195-aa5b-190775a08a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a679a87b-f28c-4c7e-9ecd-0677b662fc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d55d19714e4bae855df8902e1197e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:30Z,use_quota=True,user_id='274ebf63df6449229334406bd18d60dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6a002f-2023-4964-82ac-40ecdce87eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6a002f-2023-4964-82ac-40ecdce87eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bdc9c58-b072-4417-8b63-1414d7b59db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bdc9c58-b072-4417-8b63-1414d7b59db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a679a87b-f28c-4c7e-9ecd-0677b662fc3e', 'volume_name': 'volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeea706-c991-41dc-8398-e4e15fb4241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeea706-c991-41dc-8398-e4e15fb4241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2f8fcf-934b-4620-8d91-e58b72bfc65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Volume a679a87b-f28c-4c7e-9ecd-0677b662fc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e', 'volume_size': 1} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:30 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 1G" returned: 0 in 1.007s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:30 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 Jul 07 17:30:30 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:31 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54" returned: 0 in 0.745s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:31 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:30:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:31 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 Jul 07 17:30:31 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:32 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54" returned: 0 in 0.715s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:32 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info Jul 07 17:30:32 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:32 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:32 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Flow 'volume_create_manager' (696054a6-abb9-4a11-bfc8-76407dcc4877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a77ff34-19af-45e5-a288-76306a010358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a77ff34-19af-45e5-a288-76306a010358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1571637369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ead190d-2f54-41d0-af5f-668d59d6bdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407fcdab21ad4492938ef57ed4c2bec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:33Z,use_quota=True,user_id='f37360a084b9409595a279b36ca7879e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e24ea0-1add-48f8-b76e-52a6e5cdd3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e24ea0-1add-48f8-b76e-52a6e5cdd3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3430ac-ca73-4327-a6da-906fd7776160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3430ac-ca73-4327-a6da-906fd7776160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ead190d-2f54-41d0-af5f-668d59d6bdd6', 'volume_name': 'volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d95de1-ecbf-42d9-8c27-d4b4dc7558e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d95de1-ecbf-42d9-8c27-d4b4dc7558e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88cd5e0-c6d0-4cd9-b606-22d803f0f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:32 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Volume 9ead190d-2f54-41d0-af5f-668d59d6bdd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6', 'volume_size': 1} Jul 07 17:30:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:33 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info" returned: 0 in 0.742s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:33 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:33 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info Jul 07 17:30:33 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:33 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:30:33 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.info" returned: 0 in 0.647s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.846s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.350s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a679a87b-f28c-4c7e-9ecd-0677b662fc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d55d19714e4bae855df8902e1197e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:30Z,use_quota=True,user_id='274ebf63df6449229334406bd18d60dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Creating volume a679a87b-f28c-4c7e-9ecd-0677b662fc3e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:33 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:33 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e 1073741824 Jul 07 17:30:33 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1111eaa7-1e36-4429-bdeb-9c4b67b6f9a1 tempest-GroupSnapshotsV319Test-1837097450 None] group_snapshot 1581226e-aaee-4ac3-ba9c-eee30c2abd8f: created successfully Jul 07 17:30:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] group_snapshot 1581226e-aaee-4ac3-ba9c-eee30c2abd8f: deleting Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] group_snapshot 1581226e-aaee-4ac3-ba9c-eee30c2abd8f: deleting {{(pid=87251) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "cinder-quobyte-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "cinder-quobyte-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "cinder-quobyte-f05d934e-15d7-43db-8ddb-dccc6f0b6d54" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "cinder-quobyte-f05d934e-15d7-43db-8ddb-dccc6f0b6d54" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Deleting offline snapshot f05d934e-15d7-43db-8ddb-dccc6f0b6d54 of volume 9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] snapshot_file for this snap is: volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf903b-acd5-438e-935a-913724bf6028]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:34 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e 1073741824" returned: 0 in 1.144s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:34 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e Jul 07 17:30:34 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:35 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 Jul 07 17:30:35 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:35 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e" returned: 0 in 0.773s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.854s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1571637369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ead190d-2f54-41d0-af5f-668d59d6bdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407fcdab21ad4492938ef57ed4c2bec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:33Z,use_quota=True,user_id='f37360a084b9409595a279b36ca7879e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Creating volume 9ead190d-2f54-41d0-af5f-668d59d6bdd6 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:35 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2f8fcf-934b-4620-8d91-e58b72bfc65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:35 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 1073741824 Jul 07 17:30:35 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82359e2d-173b-4805-8d3d-ef239d3293be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:35 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Volume volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e (a679a87b-f28c-4c7e-9ecd-0677b662fc3e): created successfully Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82359e2d-173b-4805-8d3d-ef239d3293be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Flow 'volume_create_manager' (503c30ad-16ca-4cfa-80bd-81372c9378a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-eb9d97b5-f78c-42af-b5ba-157519bf4098 tempest-VolumesListAdminTestJSON-780288709 None] Created volume successfully. Jul 07 17:30:35 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54" returned: 0 in 1.016s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d18d9-426e-4b21-a3aa-ac9046a3fb30]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:36 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 Jul 07 17:30:36 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:36 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" returned: 0 in 0.902s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:36 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 1073741824" returned: 0 in 1.110s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:36 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 Jul 07 17:30:36 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Acquiring lock "cinder-a679a87b-f28c-4c7e-9ecd-0677b662fc3e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Lock "cinder-a679a87b-f28c-4c7e-9ecd-0677b662fc3e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:36 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 Jul 07 17:30:36 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Acquiring lock "cinder-quobyte-a679a87b-f28c-4c7e-9ecd-0677b662fc3e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Lock "cinder-quobyte-a679a87b-f28c-4c7e-9ecd-0677b662fc3e" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7bb2eb-cf87-4bb4-9a10-47be28a265cd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "cinder-3397c184-9d9a-493c-82eb-eaec3aca059b-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-3397c184-9d9a-493c-82eb-eaec3aca059b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "cinder-quobyte-3397c184-9d9a-493c-82eb-eaec3aca059b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-quobyte-3397c184-9d9a-493c-82eb-eaec3aca059b" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13d5b41-d219-4417-9c88-2e1c3388138e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:37 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e Jul 07 17:30:37 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:37 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b Jul 07 17:30:37 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:37 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6" returned: 0 in 0.892s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88cd5e0-c6d0-4cd9-b606-22d803f0f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36212f0b-b02f-4801-b518-6dec1c2ae18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:37 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54" returned: 0 in 1.034s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:37 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Volume volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 (9ead190d-2f54-41d0-af5f-668d59d6bdd6): created successfully Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36212f0b-b02f-4801-b518-6dec1c2ae18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Flow 'volume_create_manager' (696054a6-abb9-4a11-bfc8-76407dcc4877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f5127330-1e7d-4709-a122-45b2534a5901 tempest-AbsoluteLimitsTests-10769606 None] Created volume successfully. Jul 07 17:30:37 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54 Jul 07 17:30:37 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e" returned: 0 in 1.220s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Acquiring lock "cinder-9ead190d-2f54-41d0-af5f-668d59d6bdd6-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Lock "cinder-9ead190d-2f54-41d0-af5f-668d59d6bdd6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:38 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e Jul 07 17:30:38 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Acquiring lock "cinder-quobyte-9ead190d-2f54-41d0-af5f-668d59d6bdd6" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Lock "cinder-quobyte-9ead190d-2f54-41d0-af5f-668d59d6bdd6" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b7bd56-4699-4aee-b272-039e008d7882]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:38 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b" returned: 0 in 1.305s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:38 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b Jul 07 17:30:38 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 Jul 07 17:30:38 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1.f05d934e-15d7-43db-8ddb-dccc6f0b6d54" returned: 0 in 0.999s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "cinder-quobyte-f05d934e-15d7-43db-8ddb-dccc6f0b6d54" released by "_delete_snapshot" :: held 4.114s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "cinder-quobyte-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" released by "delete_snapshot" :: held 4.148s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:39 devstack cinder-volume[87251]: WARNING cinder.quota [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-975214864 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-975214864, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:30:39 devstack cinder-volume[87251]: WARNING cinder.quota [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-975214864 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-975214864, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] Created reservations ['3cef93d1-445f-49f2-b0bd-29d05eebd1ff', '58b63a9d-a0ba-4d3e-8f57-c9d925ac8aaa', '361ec122-c733-4dee-91f2-bddd8aee19e8', '55374e85-875a-469f-9ff8-976d53f49e63'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a2fc7e08-44bd-49d7-8ca3-761a1e558234 tempest-GroupSnapshotsV319Test-1837097450 None] group_snapshot 1581226e-aaee-4ac3-ba9c-eee30c2abd8f: deleted successfully Jul 07 17:30:39 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a679a87b-f28c-4c7e-9ecd-0677b662fc3e" returned: 0 in 1.252s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Lock "cinder-quobyte-a679a87b-f28c-4c7e-9ecd-0677b662fc3e" released by "delete_volume" :: held 2.569s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Created reservations ['5475edc8-e916-4262-9198-46e2666dd138', 'fe473f55-d1ad-4c3c-bf94-d7f7ed52e587', 'b6990de1-53af-405e-9188-212cc23684b9', 'b91cf4f8-4ced-4f35-bb3f-ecbe853645c0'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:39 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3397c184-9d9a-493c-82eb-eaec3aca059b" returned: 0 in 1.156s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "cinder-quobyte-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-quobyte-3397c184-9d9a-493c-82eb-eaec3aca059b" released by "delete_volume" :: held 2.533s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:39 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "cinder-quobyte-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" acquired by "delete_volume" :: waited 0.053s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6" returned: 0 in 1.401s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c359dc01-203c-4a1d-b59b-702ede5c0909]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:39 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6 Jul 07 17:30:39 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:40 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:40 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Created reservations ['45c40c5a-13ad-4bd8-a13f-2d890cc9bfbc', '70690995-5afc-4594-b437-ad92820ffe65', 'e69417fd-de3b-4802-984c-54190472fd02', 'acfb6209-b9b3-44aa-8508-076697f34bf7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:40 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 Jul 07 17:30:40 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:40 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:40 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "cinder-1b652798-8ee4-4f94-826d-8dc7d58e82ad-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-1b652798-8ee4-4f94-826d-8dc7d58e82ad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:40 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9ead190d-2f54-41d0-af5f-668d59d6bdd6" returned: 0 in 1.061s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "cinder-quobyte-1b652798-8ee4-4f94-826d-8dc7d58e82ad" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Lock "cinder-quobyte-9ead190d-2f54-41d0-af5f-668d59d6bdd6" released by "delete_volume" :: held 2.555s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.025s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Deleted volume successfully. Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-quobyte-1b652798-8ee4-4f94-826d-8dc7d58e82ad" acquired by "delete_volume" :: waited 0.066s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0819cc4c-4f69-47c2-ae8a-e460ebc8e211 tempest-VolumesListAdminTestJSON-780288709 None] Lock "cinder-a679a87b-f28c-4c7e-9ecd-0677b662fc3e-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f183467e-901c-4a22-b765-c14b853c61e3]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:41 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" returned: 0 in 1.256s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Created reservations ['81bf719a-da37-4de0-af13-b82483b2bbbe', '3510617b-7a66-4cf1-8304-24b524b6f46d', '29326695-bfb5-4776-917d-49b7aec8d79f', '9cf78d1c-2b21-4ebd-95d8-1a3035093b74'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:41 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1 Jul 07 17:30:41 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:41 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.070s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Deleted volume successfully. Jul 07 17:30:41 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad Jul 07 17:30:41 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-802421b1-5368-48c3-becf-5c5e7808eae5 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-3397c184-9d9a-493c-82eb-eaec3aca059b-delete_volume" released by "delete_volume" :: held 4.119s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:41 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:41 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:42 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:42 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "cinder-quobyte-9bf84de9-ffa1-4772-bd41-f7ebf34549e1" released by "delete_volume" :: held 2.288s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Deleted volume successfully. Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00ef42a9-5ed4-40ca-bfab-92b6f5edd1f7 tempest-AbsoluteLimitsTests-10769606 None] Lock "cinder-9ead190d-2f54-41d0-af5f-668d59d6bdd6-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Created reservations ['2b80afbe-b888-4ee2-b014-143c8e3dc3cd'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:42 devstack cinder-volume[87251]: WARNING cinder.quota [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-975214864 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-975214864, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:30:42 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad" returned: 0 in 1.207s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:42 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad Jul 07 17:30:42 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Created reservations ['ca198e08-3c25-4ab2-a8b5-cddda5f90fb4', '15373c94-c0a7-4da9-b9a7-57d4eef2f89a', 'e052a0dd-db04-4fc4-ae3e-4110586f8d6a', '7b87f219-b31d-46fe-9821-aa9e81a0ff62'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:42 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:42 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:43 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1b652798-8ee4-4f94-826d-8dc7d58e82ad" returned: 0 in 0.762s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-quobyte-1b652798-8ee4-4f94-826d-8dc7d58e82ad" released by "delete_volume" :: held 2.046s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Created reservations ['aa62ef91-0edd-4b75-b123-a27df4aaa3bb', '8df2b062-8212-4c64-8f39-51674122bdfe', 'b08bba2d-8efe-4d37-a9b0-9a24bb37a53d', 'b246f96d-b0cf-444d-851b-858c8bcf2c05'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:43 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.745s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bd39958e-028e-479d-b420-9a4513dedfb5 tempest-GroupSnapshotsV319Test-1837097450 None] Delete group completed successfully. Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:43 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:43 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:44 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.788s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:44 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Deleted volume successfully. Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-51724fdb-742b-4b62-ac9f-f91d9ec25ea3 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-1b652798-8ee4-4f94-826d-8dc7d58e82ad-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "cinder-5617642f-dd28-436f-9c55-adf04bacc059-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-5617642f-dd28-436f-9c55-adf04bacc059-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "cinder-quobyte-5617642f-dd28-436f-9c55-adf04bacc059" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-quobyte-5617642f-dd28-436f-9c55-adf04bacc059" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c79643-25a7-4386-a73b-a15c36bda1f9]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:44 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 Jul 07 17:30:44 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:45 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059" returned: 0 in 0.891s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:45 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059 Jul 07 17:30:45 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:46 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5617642f-dd28-436f-9c55-adf04bacc059" returned: 0 in 0.806s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-quobyte-5617642f-dd28-436f-9c55-adf04bacc059" released by "delete_volume" :: held 1.759s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Created reservations ['47487a83-6a78-4ecb-9c46-e0470cc79a68', '27e0ab83-75f3-488c-b2c7-0819fd3b9db7', '9f3f7808-3555-44b8-bcf2-edaeca703a83', '13b8aefa-06bb-4892-a517-1d2bdb028c44'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:46 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:30:46 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:47 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.894s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Deleted volume successfully. Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dee02eb7-ba51-416b-a89d-9a1211152711 tempest-VolumesListAdminTestJSON-604109140 None] Lock "cinder-5617642f-dd28-436f-9c55-adf04bacc059-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Flow 'volume_create_manager' (78f550ba-85f5-43e1-bffa-9b8e7b735299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1683b1-45e9-42d8-9650-d7195c4d4417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1683b1-45e9-42d8-9650-d7195c4d4417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-594886074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e06b5ce-6c6c-437b-ade7-3003deeb9a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd935e72b1742a9b61b371b700c5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:48Z,use_quota=True,user_id='b9c47687979a4ed8a82ee94e5890c2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e711c2e-1f7b-42c4-8500-a82d981cb83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e711c2e-1f7b-42c4-8500-a82d981cb83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06acea6d-0cfe-4010-90aa-1f307a5e6be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06acea6d-0cfe-4010-90aa-1f307a5e6be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e06b5ce-6c6c-437b-ade7-3003deeb9a75', 'volume_name': 'volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075a89b5-4720-4b28-96ab-efd11dcf1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075a89b5-4720-4b28-96ab-efd11dcf1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aabafc-4170-474a-a16a-b8ea22f075ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:47 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Volume 3e06b5ce-6c6c-437b-ade7-3003deeb9a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75', 'volume_size': 1} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-594886074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e06b5ce-6c6c-437b-ade7-3003deeb9a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd935e72b1742a9b61b371b700c5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:48Z,use_quota=True,user_id='b9c47687979a4ed8a82ee94e5890c2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Creating volume 3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:47 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:30:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:47 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 1073741824 Jul 07 17:30:47 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:48 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 1073741824" returned: 0 in 1.083s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:48 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:30:48 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:49 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aabafc-4170-474a-a16a-b8ea22f075ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253f740-0c2e-406d-9919-92d7ef40185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Volume volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 (3e06b5ce-6c6c-437b-ade7-3003deeb9a75): created successfully Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253f740-0c2e-406d-9919-92d7ef40185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Flow 'volume_create_manager' (78f550ba-85f5-43e1-bffa-9b8e7b735299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8e65a105-50b1-4aab-8b49-373fa23062f2 tempest-VolumesDeleteCascade-1612487439 None] Created volume successfully. Jul 07 17:30:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Creating offline snapshot c2ad5b98-dea9-4ee2-9886-18b874bbdf23 of volume 3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:51 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a1ccc-df24-4b18-98a0-586a603edebc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:51 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:30:51 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:52 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 0.903s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:52 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 1G Jul 07 17:30:52 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:53 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 1G" returned: 0 in 1.003s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:53 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:30:53 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:54 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 0.960s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:54 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 is being set with open permissions: ugo+rw Jul 07 17:30:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:54 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:30:54 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:54 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 0.941s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:54 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=106,cinder:UPDATE=136,cinder:INSERT=40,cinder:DELETE=7 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:30:54 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=111,cinder:INSERT=32,cinder:UPDATE=124,cinder:DELETE=13 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:30:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:55 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info Jul 07 17:30:55 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:55 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info" returned: 0 in 0.837s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:55 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info is being set with open permissions: ugo+rw Jul 07 17:30:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:55 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info Jul 07 17:30:55 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b59e7138-a843-4cbf-9152-ea45d5c9cd5f tempest-GroupsTest-552615724 None] Group tempest-Group1-1066548554: creating Jul 07 17:30:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b59e7138-a843-4cbf-9152-ea45d5c9cd5f tempest-GroupsTest-552615724 None] Group tempest-Group1-1066548554: created successfully Jul 07 17:30:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b59e7138-a843-4cbf-9152-ea45d5c9cd5f tempest-GroupsTest-552615724 None] Create group completed successfully. Jul 07 17:30:56 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.info" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.699s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a2503b02-b506-442c-8f33-bc1778ac2fe6 tempest-VolumesDeleteCascade-1612487439 None] Create snapshot completed successfully Jul 07 17:30:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Creating offline snapshot d2273e45-07dd-47bc-b633-17d6ecf71818 of volume 3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:57 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469347f-c290-4d65-b2e4-2ed4d16d07fb]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6d68b3ae-5f83-4f0b-b40a-6fd7422bc2e9 tempest-GroupsTest-552615724 None] Group tempest-Group2-1008917929: creating Jul 07 17:30:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6d68b3ae-5f83-4f0b-b40a-6fd7422bc2e9 tempest-GroupsTest-552615724 None] Group tempest-Group2-1008917929: created successfully Jul 07 17:30:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6d68b3ae-5f83-4f0b-b40a-6fd7422bc2e9 tempest-GroupsTest-552615724 None] Create group completed successfully. Jul 07 17:30:58 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:30:58 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:58 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 0.846s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:58 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 1G Jul 07 17:30:58 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:59 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Flow 'volume_create_manager' (6c24971e-a4a1-4882-9bb3-039ae954b34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a6f21c-f576-49e6-af6d-b68b08ed4e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a6f21c-f576-49e6-af6d-b68b08ed4e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425652468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7511254b-efa6-4f02-bc42-798ab58f593d,host='devstack@QuobyteHD#QuobyteHD',id=5a9a0995-d2dd-4ba8-a6b6-479047cb7787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1c8a3276c74ce2b1de8c414379d8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:00Z,use_quota=True,user_id='259ec71d8416494795270b1ce5129298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124183ba-77ba-4bd4-9bcc-426b2a4cb099),volume_type_id=124183ba-77ba-4bd4-9bcc-426b2a4cb099)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc24f71-e6d6-4b10-a1c7-11df34818ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:00 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc24f71-e6d6-4b10-a1c7-11df34818ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2587a6-020e-4f76-90b9-451a73b92447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2587a6-020e-4f76-90b9-451a73b92447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9a0995-d2dd-4ba8-a6b6-479047cb7787', 'volume_name': 'volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee12552f-3d1a-4ae6-a877-21b19fe4a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee12552f-3d1a-4ae6-a877-21b19fe4a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85855aea-58a0-4b32-a559-a39a831fb51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Volume 5a9a0995-d2dd-4ba8-a6b6-479047cb7787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787', 'volume_size': 1} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 1G" returned: 0 in 1.221s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:00 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 Jul 07 17:31:00 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:00 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818" returned: 0 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 is being set with open permissions: ugo+rw Jul 07 17:31:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:00 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 Jul 07 17:31:00 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:01 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818" returned: 0 in 0.699s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.767s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7511254b-efa6-4f02-bc42-798ab58f593d,created_at=2026-07-07T15:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425652468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7511254b-efa6-4f02-bc42-798ab58f593d,host='devstack@QuobyteHD#QuobyteHD',id=5a9a0995-d2dd-4ba8-a6b6-479047cb7787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1c8a3276c74ce2b1de8c414379d8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:00Z,use_quota=True,user_id='259ec71d8416494795270b1ce5129298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124183ba-77ba-4bd4-9bcc-426b2a4cb099),volume_type_id=124183ba-77ba-4bd4-9bcc-426b2a4cb099)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Creating volume 5a9a0995-d2dd-4ba8-a6b6-479047cb7787 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:01 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:31:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3e356649-97ba-4d14-ac55-4464c50ff59d tempest-VolumesDeleteCascade-1612487439 None] Create snapshot completed successfully Jul 07 17:31:01 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 1073741824 Jul 07 17:31:01 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-3e06b5ce-6c6c-437b-ade7-3003deeb9a75-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-3e06b5ce-6c6c-437b-ade7-3003deeb9a75-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Performing cascade delete. {{(pid=87251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-c2ad5b98-dea9-4ee2-9886-18b874bbdf23-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-c2ad5b98-dea9-4ee2-9886-18b874bbdf23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-c2ad5b98-dea9-4ee2-9886-18b874bbdf23" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-c2ad5b98-dea9-4ee2-9886-18b874bbdf23" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Deleting offline snapshot c2ad5b98-dea9-4ee2-9886-18b874bbdf23 of volume 3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] snapshot_file for this snap is: volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6642f5b7-5721-43d5-88a7-32809dc9709c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:02 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:31:02 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 1073741824" returned: 0 in 1.684s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:03 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 Jul 07 17:31:03 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 1.280s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:03 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1cd78-8623-444e-b54f-59b4df634786]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:04 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:31:04 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:04 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787" returned: 0 in 1.201s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] <== create_volume: return (2970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.973s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85855aea-58a0-4b32-a559-a39a831fb51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2039d34-2683-4baa-8af6-123ef4a10e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:04 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Volume volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 (5a9a0995-d2dd-4ba8-a6b6-479047cb7787): created successfully Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2039d34-2683-4baa-8af6-123ef4a10e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Flow 'volume_create_manager' (6c24971e-a4a1-4882-9bb3-039ae954b34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4f3aedd7-6da3-472b-8c60-47e6619dfaf2 tempest-GroupsTest-552615724 None] Created volume successfully. Jul 07 17:31:05 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 1.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35f9920-44cd-4c73-980d-103acc441a03]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:05 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 Jul 07 17:31:05 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Acquiring lock "cinder-quobyte-5a9a0995-d2dd-4ba8-a6b6-479047cb7787" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Lock "cinder-quobyte-5a9a0995-d2dd-4ba8-a6b6-479047cb7787" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb78c20-61ff-482d-b1a4-6f505c8e0b72]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 Jul 07 17:31:06 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:06 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818" returned: 0 in 1.149s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218ee7e-8de7-406d-9788-12ba5808ce24]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:31:06 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787" returned: 0 in 1.301s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:07 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787 Jul 07 17:31:07 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 1.145s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe582a75-a98a-4f4e-b647-25bca955ea98]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:31:08 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a9a0995-d2dd-4ba8-a6b6-479047cb7787" returned: 0 in 0.923s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Lock "cinder-quobyte-5a9a0995-d2dd-4ba8-a6b6-479047cb7787" released by "delete_volume" :: held 2.301s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Created reservations ['294a8c98-ae87-4a9e-ad46-e8ec295af06e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:08 devstack cinder-volume[87251]: WARNING cinder.quota [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-332661300 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-332661300, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:08 devstack cinder-volume[87251]: WARNING cinder.quota [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-332661300 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-332661300, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Created reservations ['6827a6d5-98cb-4107-b76e-344bece01d91', '29076614-4582-49c2-9cdf-fbcf70b69160', 'c25a87f1-27af-4b02-95e9-2b06bff9a338', '4fc59fd0-eaad-46ab-940d-207679dab026'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:08 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 1.005s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:31:08 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Created reservations ['67cd2895-ae22-4006-8982-366e40d11a8a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:09 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:09 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:09 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3b0cade2-22e9-4b6d-be21-c900925a51b5 tempest-GroupsTest-552615724 None] Delete group completed successfully. Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Flow 'volume_create_manager' (2332752c-764a-4b5e-8aa5-2c82f3b49129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f526ac-fb93-4d0c-970e-0d3d76632c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f526ac-fb93-4d0c-970e-0d3d76632c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793077382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8905adc5-acd1-457e-9796-4863469dc5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff56fb9f47479786624e5627633106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:10Z,use_quota=True,user_id='19bbc8d55a5c4effa75d8540a9b76ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6241e066-7270-4c99-8770-259c5f65fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6241e066-7270-4c99-8770-259c5f65fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b9d562-35cc-42d7-8418-e346fa6064e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b9d562-35cc-42d7-8418-e346fa6064e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8905adc5-acd1-457e-9796-4863469dc5a4', 'volume_name': 'volume-8905adc5-acd1-457e-9796-4863469dc5a4', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e701e84e-3fe6-4d98-ab4a-ca6d217a8ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e701e84e-3fe6-4d98-ab4a-ca6d217a8ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b1be38-0f0d-4e97-8145-6c519aab3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Volume 8905adc5-acd1-457e-9796-4863469dc5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8905adc5-acd1-457e-9796-4863469dc5a4', 'volume_size': 1} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793077382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8905adc5-acd1-457e-9796-4863469dc5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff56fb9f47479786624e5627633106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:10Z,use_quota=True,user_id='19bbc8d55a5c4effa75d8540a9b76ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Creating volume 8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:09 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 0.918s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:09 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 1073741824 Jul 07 17:31:09 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:09 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23 Jul 07 17:31:09 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:10 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.781s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:10 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b25de02b-90f4-463f-ace1-95d029dae06d tempest-GroupsTest-552615724 None] Delete group completed successfully. Jul 07 17:31:10 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.c2ad5b98-dea9-4ee2-9886-18b874bbdf23" returned: 0 in 0.731s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 -F qcow2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:10 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 -F qcow2 Jul 07 17:31:10 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:10 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 1073741824" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-087b5cf2-1c56-4177-8ad2-3ea4d95dc423 tempest-GroupsTest-552615724 None] Group tempest-GroupsTest-Group-1425978772: creating Jul 07 17:31:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-087b5cf2-1c56-4177-8ad2-3ea4d95dc423 tempest-GroupsTest-552615724 None] Group tempest-GroupsTest-Group-1425978772: created successfully Jul 07 17:31:10 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:31:10 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-087b5cf2-1c56-4177-8ad2-3ea4d95dc423 tempest-GroupsTest-552615724 None] Create group completed successfully. Jul 07 17:31:11 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 -F qcow2" returned: 0 in 0.754s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-c2ad5b98-dea9-4ee2-9886-18b874bbdf23" released by "_delete_snapshot" :: held 8.923s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" released by "delete_snapshot" :: held 8.958s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Created reservations ['eecb4367-bbec-438d-ab56-dc3548c73bcc', 'b365c112-65fc-456d-aae5-befba8e2cf4b', 'cd50d5ea-5eda-4983-86ec-f342a406ed68', '1c97d348-7c57-44ac-ab83-5c625193debf'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Delete snapshot completed successfully. Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-c2ad5b98-dea9-4ee2-9886-18b874bbdf23-delete_snapshot" released by "delete_snapshot" :: held 9.120s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-d2273e45-07dd-47bc-b633-17d6ecf71818-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-d2273e45-07dd-47bc-b633-17d6ecf71818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-d2273e45-07dd-47bc-b633-17d6ecf71818" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:11 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 0.704s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-d2273e45-07dd-47bc-b633-17d6ecf71818" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Deleting offline snapshot d2273e45-07dd-47bc-b633-17d6ecf71818 of volume 3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] snapshot_file for this snap is: volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b1be38-0f0d-4e97-8145-6c519aab3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8905adc5-acd1-457e-9796-4863469dc5a4', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4839c5-1744-4da0-ab6c-62261af98d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410ad1b-5655-4f9d-960a-ede755562f7a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Volume volume-8905adc5-acd1-457e-9796-4863469dc5a4 (8905adc5-acd1-457e-9796-4863469dc5a4): created successfully Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4839c5-1744-4da0-ab6c-62261af98d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Flow 'volume_create_manager' (2332752c-764a-4b5e-8aa5-2c82f3b49129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7a9625f6-c49d-4d5b-a78b-85e36f0aeb99 tempest-VolumesActionsTest-740516094 None] Created volume successfully. Jul 07 17:31:11 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 Jul 07 17:31:11 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Flow 'volume_create_manager' (4cdddbb9-abce-4ec6-bf97-581d51b1afe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50e33c3-dff8-4485-8346-6afa2fc315a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818" returned: 0 in 0.997s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50e33c3-dff8-4485-8346-6afa2fc315a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-260622567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f298f2a-79f3-4d2f-9449-e4152af22bb6,host='devstack@QuobyteHD#QuobyteHD',id=054387f5-fdac-479b-9115-358fe99a4fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1c8a3276c74ce2b1de8c414379d8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:12Z,use_quota=True,user_id='259ec71d8416494795270b1ce5129298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(499e50a5-d1fa-41f6-966c-6b774fe598b1),volume_type_id=499e50a5-d1fa-41f6-966c-6b774fe598b1)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e58ff3-fd71-4032-8f34-f8b169cff87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e58ff3-fd71-4032-8f34-f8b169cff87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f21f18-5e7a-4083-a9ca-9551b00920ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f21f18-5e7a-4083-a9ca-9551b00920ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054387f5-fdac-479b-9115-358fe99a4fd2', 'volume_name': 'volume-054387f5-fdac-479b-9115-358fe99a4fd2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b8123a-4d60-4533-bd95-72b4539eaf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b8123a-4d60-4533-bd95-72b4539eaf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30508993-b977-426b-90a8-95184566f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Volume 054387f5-fdac-479b-9115-358fe99a4fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054387f5-fdac-479b-9115-358fe99a4fd2', 'volume_size': 1} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f298f2a-79f3-4d2f-9449-e4152af22bb6,created_at=2026-07-07T15:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-260622567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f298f2a-79f3-4d2f-9449-e4152af22bb6,host='devstack@QuobyteHD#QuobyteHD',id=054387f5-fdac-479b-9115-358fe99a4fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1c8a3276c74ce2b1de8c414379d8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:12Z,use_quota=True,user_id='259ec71d8416494795270b1ce5129298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(499e50a5-d1fa-41f6-966c-6b774fe598b1),volume_type_id=499e50a5-d1fa-41f6-966c-6b774fe598b1)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Creating volume 054387f5-fdac-479b-9115-358fe99a4fd2 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:12 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1151ff-5ed9-4a22-8d9c-362b7278ce24]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 1073741824 Jul 07 17:31:12 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:31:12 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:13 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 1.013s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:13 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 Jul 07 17:31:13 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:13 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 1073741824" returned: 0 in 1.161s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:13 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 Jul 07 17:31:13 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:14 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818" returned: 0 in 0.905s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:14 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:14 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818 Jul 07 17:31:14 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30508993-b977-426b-90a8-95184566f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054387f5-fdac-479b-9115-358fe99a4fd2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f6a417-71cf-4741-b0f4-79823690dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Volume volume-054387f5-fdac-479b-9115-358fe99a4fd2 (054387f5-fdac-479b-9115-358fe99a4fd2): created successfully Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f6a417-71cf-4741-b0f4-79823690dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Flow 'volume_create_manager' (4cdddbb9-abce-4ec6-bf97-581d51b1afe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b72ac75e-70df-4c6f-9b6a-9d86801e80b4 tempest-GroupsTest-552615724 None] Created volume successfully. Jul 07 17:31:15 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75.d2273e45-07dd-47bc-b633-17d6ecf71818" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-d2273e45-07dd-47bc-b633-17d6ecf71818" released by "_delete_snapshot" :: held 3.925s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" released by "delete_snapshot" :: held 3.961s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Created reservations ['1108de69-cede-4f2c-8271-904aaf189642', '11b480c4-ff6f-46b9-a201-a2e4ff8c6446', '97a1f323-c24f-4b63-8c9f-50020f808641', '1d2412c0-ad4f-4131-a204-c25d6b959a83'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:15 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Delete snapshot completed successfully. Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-d2273e45-07dd-47bc-b633-17d6ecf71818-delete_snapshot" released by "delete_snapshot" :: held 4.271s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Snapshots deleted, issuing volume delete {{(pid=87251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Flow 'volume_create_manager' (97be9872-f3e4-4dbb-ae2d-9f5264eb017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e1e06c-6a91-476f-b79e-759fc705ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" acquired by "delete_volume" :: waited 0.055s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e1e06c-6a91-476f-b79e-759fc705ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700109849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f298f2a-79f3-4d2f-9449-e4152af22bb6,host='devstack@QuobyteHD#QuobyteHD',id=a36063db-1e2c-4b10-a034-cfd4b6ec0ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1c8a3276c74ce2b1de8c414379d8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:16Z,use_quota=True,user_id='259ec71d8416494795270b1ce5129298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(499e50a5-d1fa-41f6-966c-6b774fe598b1),volume_type_id=499e50a5-d1fa-41f6-966c-6b774fe598b1)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bc9340-b6d0-4416-8f14-e597c3b36304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bc9340-b6d0-4416-8f14-e597c3b36304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2c40e5-b5d2-44c0-8b6e-2e7876257fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2c40e5-b5d2-44c0-8b6e-2e7876257fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36063db-1e2c-4b10-a034-cfd4b6ec0ab6', 'volume_name': 'volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07380965-9755-4469-8075-6e46c1cb1028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07380965-9755-4469-8075-6e46c1cb1028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0176da70-4065-4782-8db4-5718655c96b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:15 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Volume a36063db-1e2c-4b10-a034-cfd4b6ec0ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6', 'volume_size': 1} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f298f2a-79f3-4d2f-9449-e4152af22bb6,created_at=2026-07-07T15:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700109849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f298f2a-79f3-4d2f-9449-e4152af22bb6,host='devstack@QuobyteHD#QuobyteHD',id=a36063db-1e2c-4b10-a034-cfd4b6ec0ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1c8a3276c74ce2b1de8c414379d8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:16Z,use_quota=True,user_id='259ec71d8416494795270b1ce5129298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(499e50a5-d1fa-41f6-966c-6b774fe598b1),volume_type_id=499e50a5-d1fa-41f6-966c-6b774fe598b1)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Creating volume a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:15 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f2e4e-c530-47e7-9d6f-4137db4729a2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:15 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 1073741824 Jul 07 17:31:15 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:31:16 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 0.867s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:16 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:16 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75 Jul 07 17:31:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 1073741824" returned: 0 in 0.909s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:16 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:16 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 Jul 07 17:31:16 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:17 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" returned: 0 in 0.897s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:17 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-3e06b5ce-6c6c-437b-ade7-3003deeb9a75" released by "delete_volume" :: held 1.894s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6" returned: 0 in 0.859s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0176da70-4065-4782-8db4-5718655c96b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a585e4-8634-40cf-ba19-98590d296c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Volume volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 (a36063db-1e2c-4b10-a034-cfd4b6ec0ab6): created successfully Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a585e4-8634-40cf-ba19-98590d296c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Flow 'volume_create_manager' (97be9872-f3e4-4dbb-ae2d-9f5264eb017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9f6e9c70-8fb2-4130-b739-ab11ad84609b tempest-GroupsTest-552615724 None] Created volume successfully. Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Created reservations ['739aa9bd-c66d-4bd1-912b-3abf4ecda137', 'e537b396-b1c7-494c-bc7b-1bc7125c2bac', '7fa387b4-91ce-414b-b281-a5272360421f', '0288f182-d56c-4441-867b-91126fe42e2a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:17 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:17 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2754d9f9-aadf-407f-bf2c-5adf7e5dcec3 tempest-GroupsTest-552615724 None] Update group completed successfully. Jul 07 17:31:18 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.924s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:18 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Deleted volume successfully. Jul 07 17:31:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f990cda9-9342-459a-b5b1-d80f162a90d3 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-3e06b5ce-6c6c-437b-ade7-3003deeb9a75-delete_volume" released by "delete_volume" :: held 16.662s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Flow 'volume_create_manager' (2efd0331-73d1-476f-a3f7-e32fca3ba14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87da6813-2a28-4ffc-9830-b6ddec1d99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87da6813-2a28-4ffc-9830-b6ddec1d99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1621754102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88cefc4-5a37-4ead-8b29-4d656384a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd935e72b1742a9b61b371b700c5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:19Z,use_quota=True,user_id='b9c47687979a4ed8a82ee94e5890c2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3a3639-5b4d-4663-98a3-8be5bae0b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3a3639-5b4d-4663-98a3-8be5bae0b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617baa3d-7097-41bf-882c-7273c1abd5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617baa3d-7097-41bf-882c-7273c1abd5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88cefc4-5a37-4ead-8b29-4d656384a93b', 'volume_name': 'volume-f88cefc4-5a37-4ead-8b29-4d656384a93b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbde4b2-1bd9-4603-86f9-346c39ddd379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbde4b2-1bd9-4603-86f9-346c39ddd379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2b1bb5-c4a1-4412-892d-6771eb910fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:19 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Volume f88cefc4-5a37-4ead-8b29-4d656384a93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88cefc4-5a37-4ead-8b29-4d656384a93b', 'volume_size': 1} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1621754102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88cefc4-5a37-4ead-8b29-4d656384a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd935e72b1742a9b61b371b700c5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:19Z,use_quota=True,user_id='b9c47687979a4ed8a82ee94e5890c2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Creating volume f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:19 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:31:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:19 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b 1073741824 Jul 07 17:31:19 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d37f5f68-4c29-4e9f-9802-c13ab2dc2531 tempest-GroupsTest-552615724 None] Update group completed successfully. Jul 07 17:31:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-bac77e6d-f37a-42be-a2ce-001b3b0226da req-36d48e58-218a-42e5-bd68-c0bca3d437e3 tempest-TestMinimumBasicScenario-427956041 None] Terminate volume connection completed successfully. Jul 07 17:31:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-bac77e6d-f37a-42be-a2ce-001b3b0226da req-36d48e58-218a-42e5-bd68-c0bca3d437e3 tempest-TestMinimumBasicScenario-427956041 None] Deleting attachment 0ad3c7b4-d07f-4b60-9903-5fa77a093073. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:31:20 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b 1073741824" returned: 0 in 1.407s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:21 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:21 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Acquiring lock "cinder-quobyte-054387f5-fdac-479b-9115-358fe99a4fd2" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Lock "cinder-quobyte-054387f5-fdac-479b-9115-358fe99a4fd2" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6085f-cc1d-4047-aa84-c2b2844ae781]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:21 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 0.944s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:21 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 Jul 07 17:31:21 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2b1bb5-c4a1-4412-892d-6771eb910fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88cefc4-5a37-4ead-8b29-4d656384a93b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24fc9eb-1388-45f4-a873-4c6778c7dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:22 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Volume volume-f88cefc4-5a37-4ead-8b29-4d656384a93b (f88cefc4-5a37-4ead-8b29-4d656384a93b): created successfully Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24fc9eb-1388-45f4-a873-4c6778c7dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Flow 'volume_create_manager' (2efd0331-73d1-476f-a3f7-e32fca3ba14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f15eb264-45d0-4115-8404-1717ba545052 tempest-VolumesDeleteCascade-1612487439 None] Created volume successfully. Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Acquiring lock "cinder-c4a42177-531b-4b5f-b2e3-af763f767bc5-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Lock "cinder-c4a42177-531b-4b5f-b2e3-af763f767bc5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Acquiring lock "cinder-quobyte-c4a42177-531b-4b5f-b2e3-af763f767bc5" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Lock "cinder-quobyte-c4a42177-531b-4b5f-b2e3-af763f767bc5" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5918973-e9da-47a6-963a-87f07bfb9164]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:22 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2" returned: 0 in 0.988s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:22 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 Jul 07 17:31:22 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:22 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2 Jul 07 17:31:22 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Creating offline snapshot 29eb7e63-e231-494e-a4d3-8ff600666e03 of volume f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1484414-2df8-4a22-8452-30decd3e5c7a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:23 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:23 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:23 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5" returned: 0 in 0.923s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:23 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-054387f5-fdac-479b-9115-358fe99a4fd2" returned: 0 in 0.826s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:23 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5 Jul 07 17:31:23 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Lock "cinder-quobyte-054387f5-fdac-479b-9115-358fe99a4fd2" released by "delete_volume" :: held 1.878s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Acquiring lock "cinder-quobyte-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Lock "cinder-quobyte-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[96307a85-6ab9-4c55-ac23-2b37852ad41a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:23 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 Jul 07 17:31:23 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:23 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 0.966s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:23 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 1G Jul 07 17:31:23 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:24 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c4a42177-531b-4b5f-b2e3-af763f767bc5" returned: 0 in 0.798s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Lock "cinder-quobyte-c4a42177-531b-4b5f-b2e3-af763f767bc5" released by "delete_volume" :: held 1.776s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Created reservations ['65c33ddb-583d-425c-ad87-15b4d03d5d9a', '66b86c8c-a5ac-43c2-9745-f0a766286c4c', '70bcfb13-2558-45d7-81eb-cbe20d159b89', '131608b0-0853-4f39-b4be-dd9ad1536110'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:24 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:24 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:24 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6" returned: 0 in 0.874s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:24 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6 Jul 07 17:31:24 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:24 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 1G" returned: 0 in 0.997s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88cefc4-5a37-4ead-8b29-4d656384a93b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:24 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88cefc4-5a37-4ead-8b29-4d656384a93b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 Jul 07 17:31:24 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:25 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:25 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Deleted volume successfully. Jul 07 17:31:25 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6" returned: 0 in 0.876s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Lock "cinder-quobyte-a36063db-1e2c-4b10-a034-cfd4b6ec0ab6" released by "delete_volume" :: held 1.839s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f683e33e-78a3-418f-861f-ab500d67e599 tempest-TestMinimumBasicScenario-427956041 None] Lock "cinder-c4a42177-531b-4b5f-b2e3-af763f767bc5-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Created reservations ['abfad327-4ed3-4f44-9236-0faa4095b12e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:25 devstack cinder-volume[87251]: WARNING cinder.quota [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-784468139 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-784468139, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:25 devstack cinder-volume[87251]: WARNING cinder.quota [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-784468139 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-784468139, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Created reservations ['27adac05-8bdb-4b9a-98d2-91a68fca79cb', 'abfd9624-4e97-4be8-a190-0eb36302fa28', '9cfd8faa-8960-4fb8-96a4-62fac3fe08d0', 'dfcd1f6f-b169-4fe7-9bdf-2161dc42d52c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Created reservations ['afa2bbc5-0adf-4d43-8520-69136abafdaa', 'd007cc6e-2d45-47ed-bc8e-e06ac1c247c0', '131d9f24-4127-4258-8c75-ab5c1b91af1e', '54f8eef4-b545-4dc0-890a-dc4aad652f14'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:25 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88cefc4-5a37-4ead-8b29-4d656384a93b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:25 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 is being set with open permissions: ugo+rw Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:25 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:25 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:25 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:25 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:26 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03" returned: 0 in 0.978s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:27 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info Jul 07 17:31:27 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:27 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.402s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:27 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f2ec6c15-a41b-4992-81d8-9883df7afa2e tempest-GroupsTest-552615724 None] Delete group completed successfully. Jul 07 17:31:27 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info" returned: 0 in 0.995s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:27 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info is being set with open permissions: ugo+rw Jul 07 17:31:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:27 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info Jul 07 17:31:27 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:28 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.info" returned: 0 in 1.005s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.069s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4df2cc7c-520f-4958-bf50-10b855820850 tempest-VolumesDeleteCascade-1612487439 None] Create snapshot completed successfully Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Flow 'volume_create_manager' (01191b15-4322-4b67-ae5f-893d2e974839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9062d01-5680-4691-993a-5b53a05a6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9062d01-5680-4691-993a-5b53a05a6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-955360739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f2ca54-3d34-4bb0-a612-aca7551d42d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd935e72b1742a9b61b371b700c5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29eb7e63-e231-494e-a4d3-8ff600666e03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:30Z,use_quota=True,user_id='b9c47687979a4ed8a82ee94e5890c2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071f628b-a8fd-4db5-a8e5-dd42ee04a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071f628b-a8fd-4db5-a8e5-dd42ee04a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe489c1-ba54-4619-ba57-e947ff59bc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe489c1-ba54-4619-ba57-e947ff59bc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5f2ca54-3d34-4bb0-a612-aca7551d42d0', 'volume_name': 'volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0', 'volume_size': 1, 'snapshot_id': '29eb7e63-e231-494e-a4d3-8ff600666e03'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1beccd-9358-45ac-928c-7b2278189174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1beccd-9358-45ac-928c-7b2278189174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7447ee53-8613-4c51-bb03-0e6e21d5d223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Volume b5f2ca54-3d34-4bb0-a612-aca7551d42d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0', 'volume_size': 1, 'snapshot_id': '29eb7e63-e231-494e-a4d3-8ff600666e03'} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-29eb7e63-e231-494e-a4d3-8ff600666e03-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-29eb7e63-e231-494e-a4d3-8ff600666e03-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Creating volume b5f2ca54-3d34-4bb0-a612-aca7551d42d0 from snapshot 29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] snapshot: 29eb7e63-e231-494e-a4d3-8ff600666e03, volume: b5f2ca54-3d34-4bb0-a612-aca7551d42d0, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d882b3d-f3d6-43e5-86f4-4b9c7ce1032d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:30 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 Jul 07 17:31:30 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:31 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03" returned: 0 in 1.078s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f88cefc4-5a37-4ead-8b29-4d656384a93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd493d-90db-4010-9d50-edc8ed622c85]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0fd385b7-8fcc-401e-b085-f7a4fc4a357d tempest-VolumesActionsTest-740516094 None] Acquiring lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4" by "attach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0fd385b7-8fcc-401e-b085-f7a4fc4a357d tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4" acquired by "attach_volume" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:31 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:31 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0fd385b7-8fcc-401e-b085-f7a4fc4a357d tempest-VolumesActionsTest-740516094 None] Attaching volume 8905adc5-acd1-457e-9796-4863469dc5a4 to instance 16e9bb21-7cf0-41b7-93e9-d64dc451d7a1 at mountpoint /dev/vdb on host None. Jul 07 17:31:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0fd385b7-8fcc-401e-b085-f7a4fc4a357d tempest-VolumesActionsTest-740516094 None] Attach volume completed successfully. Jul 07 17:31:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0fd385b7-8fcc-401e-b085-f7a4fc4a357d tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4" released by "attach_volume" :: held 0.169s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-38911955-d77f-4013-8f91-6afac2b5f864 tempest-VolumesActionsTest-740516094 None] Acquiring lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-detach_volume" by "detach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-38911955-d77f-4013-8f91-6afac2b5f864 tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-38911955-d77f-4013-8f91-6afac2b5f864 tempest-VolumesActionsTest-740516094 None] Detaching volume 8905adc5-acd1-457e-9796-4863469dc5a4 from instance 16e9bb21-7cf0-41b7-93e9-d64dc451d7a1. Jul 07 17:31:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-38911955-d77f-4013-8f91-6afac2b5f864 tempest-VolumesActionsTest-740516094 None] Detach volume completed successfully. Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-38911955-d77f-4013-8f91-6afac2b5f864 tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:32 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 1.233s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:31:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:32 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:32 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:32 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 Jul 07 17:31:32 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:34 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.428s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:34 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:31:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:31:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Flow 'volume_create_manager' (cc4da66f-2b8c-4a18-b102-a6b0671d0ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e986c8-988c-471e-a315-b5e366f9e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e986c8-988c-471e-a315-b5e366f9e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1638415561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa5527-3713-4c2b-a6f0-b20096e1e01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df1f85200a5642ee8418f742b23e15a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:35Z,use_quota=True,user_id='5208cc0926984de1a34e103a4d46dcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa7ef2b-50de-4fce-aa6d-e2593e6c4ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa7ef2b-50de-4fce-aa6d-e2593e6c4ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9cc2a9-fb8f-4645-ab1e-705897240159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9cc2a9-fb8f-4645-ab1e-705897240159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfa5527-3713-4c2b-a6f0-b20096e1e01f', 'volume_name': 'volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d722623-42fe-4363-9a51-145b655e50b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d722623-42fe-4363-9a51-145b655e50b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf00c80-3eca-4b58-83a5-82c6167acbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:35 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f', 'volume_size': 1} Jul 07 17:31:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:39 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" returned: 0 in 6.873s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:39 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c0d1d-a950-44cb-a095-13dd54631e85]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:39 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:39 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:40 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 1.089s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:40 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:31:40 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Converted 1024.00 MB image at 148.96 MB/s Jul 07 17:31:40 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 is being set with open permissions: ugo+rw Jul 07 17:31:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:40 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 Jul 07 17:31:40 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:41 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" returned: 0 in 0.829s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" released by "_copy_volume_from_snapshot" :: held 11.216s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-29eb7e63-e231-494e-a4d3-8ff600666e03-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" released by "_create_volume_from_snapshot" :: held 11.271s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.293s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.319s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1638415561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa5527-3713-4c2b-a6f0-b20096e1e01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df1f85200a5642ee8418f742b23e15a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:35Z,use_quota=True,user_id='5208cc0926984de1a34e103a4d46dcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Creating volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:41 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:41 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f 1073741824 Jul 07 17:31:41 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7447ee53-8613-4c51-bb03-0e6e21d5d223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0', 'volume_size': 1, 'snapshot_id': '29eb7e63-e231-494e-a4d3-8ff600666e03'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97307123-49c6-4bf8-8f6a-2c9674d04690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:41 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Volume volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 (b5f2ca54-3d34-4bb0-a612-aca7551d42d0): created successfully Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97307123-49c6-4bf8-8f6a-2c9674d04690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Flow 'volume_create_manager' (01191b15-4322-4b67-ae5f-893d2e974839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-21e95685-cb1f-440b-9b39-ff9df79c1f0b tempest-VolumesDeleteCascade-1612487439 None] Created volume successfully. Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-f88cefc4-5a37-4ead-8b29-4d656384a93b-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-f88cefc4-5a37-4ead-8b29-4d656384a93b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Performing cascade delete. {{(pid=87251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-29eb7e63-e231-494e-a4d3-8ff600666e03-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-29eb7e63-e231-494e-a4d3-8ff600666e03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-f88cefc4-5a37-4ead-8b29-4d656384a93b" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-f88cefc4-5a37-4ead-8b29-4d656384a93b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-29eb7e63-e231-494e-a4d3-8ff600666e03" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:42 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f 1073741824" returned: 0 in 1.132s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-29eb7e63-e231-494e-a4d3-8ff600666e03" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Deleting offline snapshot 29eb7e63-e231-494e-a4d3-8ff600666e03 of volume f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] snapshot_file for this snap is: volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e95aa-c4e3-4a6e-ab84-c0ef82907e4a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:42 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f Jul 07 17:31:42 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:42 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 Jul 07 17:31:42 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:43 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" returned: 0 in 0.791s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf00c80-3eca-4b58-83a5-82c6167acbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5121827-fc5e-483d-9133-48a373c794d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:43 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Volume volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f (1bfa5527-3713-4c2b-a6f0-b20096e1e01f): created successfully Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5121827-fc5e-483d-9133-48a373c794d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Flow 'volume_create_manager' (cc4da66f-2b8c-4a18-b102-a6b0671d0ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a3eaec5f-cbd8-4e90-aff9-e1977598675b tempest-SnapshotsActionsTest-131613167 None] Created volume successfully. Jul 07 17:31:43 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03" returned: 0 in 0.950s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f88cefc4-5a37-4ead-8b29-4d656384a93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5c29d-0202-4014-9acd-34d58d79353f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:43 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:43 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Creating offline snapshot bca585b5-be22-4fe8-90ed-9dd0cc320d50 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4bbb6-e9c8-4bfb-a56d-e867bf197250]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:44 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f Jul 07 17:31:44 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:44 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 1.046s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:44 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 Jul 07 17:31:44 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:45 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" returned: 0 in 1.024s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:45 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 1G Jul 07 17:31:45 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:45 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:45 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03 Jul 07 17:31:45 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:46 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 1G" returned: 0 in 1.018s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:46 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:31:46 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:46 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b.29eb7e63-e231-494e-a4d3-8ff600666e03" returned: 0 in 0.867s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-29eb7e63-e231-494e-a4d3-8ff600666e03" released by "_delete_snapshot" :: held 3.934s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-f88cefc4-5a37-4ead-8b29-4d656384a93b" released by "delete_snapshot" :: held 3.971s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Created reservations ['96829411-ad5d-4721-b74d-8320cf16f9ff', '95f819cb-88ae-4417-97ee-fe8c0795dcdd', '44d2fb05-7979-46ad-98b9-02f69a40f7db', '3bfb34ca-81e1-4e98-8aaf-751ba0ab9911'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Delete snapshot completed successfully. Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-29eb7e63-e231-494e-a4d3-8ff600666e03-delete_snapshot" released by "delete_snapshot" :: held 4.190s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Snapshots deleted, issuing volume delete {{(pid=87251) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-f88cefc4-5a37-4ead-8b29-4d656384a93b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-f88cefc4-5a37-4ead-8b29-4d656384a93b" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac18817-8919-407b-9e39-f608dfe8affc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:47 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:47 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:47 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.891s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:47 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 is being set with open permissions: ugo+rw Jul 07 17:31:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:47 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:31:47 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:47 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 1.026s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:47 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b Jul 07 17:31:47 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:47 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.800s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:48 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info Jul 07 17:31:48 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:48 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f88cefc4-5a37-4ead-8b29-4d656384a93b" returned: 0 in 0.829s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-f88cefc4-5a37-4ead-8b29-4d656384a93b" released by "delete_volume" :: held 1.934s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:48 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:48 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info is being set with open permissions: ugo+rw Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:48 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Created reservations ['88722fe3-25ee-406f-906f-51d482f5657b', 'e28eda21-b075-4c38-8565-2da1fe3c65ee', '310a6a2b-bd99-443a-a6a2-794b9e82dc35', '91ffeeb3-dbab-41d7-a0d5-25ba874af01e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:48 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info Jul 07 17:31:48 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:49 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:49 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-b5f2ca54-3d34-4bb0-a612-aca7551d42d0-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-b5f2ca54-3d34-4bb0-a612-aca7551d42d0-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "cinder-quobyte-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8163a9-5f2b-4f6a-a302-7454fe7384d8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:49 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.info" returned: 0 in 1.078s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.793s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7f380f35-5f9b-4499-88d3-9e409ea1864a tempest-SnapshotsActionsTest-131613167 None] Create snapshot completed successfully Jul 07 17:31:50 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 Jul 07 17:31:50 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:50 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.237s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:50 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Deleted volume successfully. Jul 07 17:31:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-05e6c458-1d1f-46be-b22b-a27737ae7cf5 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-f88cefc4-5a37-4ead-8b29-4d656384a93b-delete_volume" released by "delete_volume" :: held 7.768s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:51 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" returned: 0 in 1.444s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:51 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0 Jul 07 17:31:51 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Creating offline snapshot 64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b80cce8-8d80-4118-bf6d-3038dbf32c18]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:51 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:31:51 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:52 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" returned: 0 in 0.956s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-quobyte-b5f2ca54-3d34-4bb0-a612-aca7551d42d0" released by "delete_volume" :: held 2.472s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Created reservations ['5664c473-bdb1-466b-b027-fa1591c60ad3', '772d30c0-cbf9-4985-87ff-546a55e3061a', '745034d4-c204-4f4d-a504-d8e10737785b', 'bdeb3014-9168-401c-9f1d-3a8782863312'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:52 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:31:52 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:52 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 1.017s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:52 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 1G Jul 07 17:31:52 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:53 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.871s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:53 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Deleted volume successfully. Jul 07 17:31:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-434301ec-bd97-4d09-84b1-7871e37815e1 tempest-VolumesDeleteCascade-1612487439 None] Lock "cinder-b5f2ca54-3d34-4bb0-a612-aca7551d42d0-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:53 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 1G" returned: 0 in 1.058s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:53 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 Jul 07 17:31:53 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:54 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" returned: 0 in 0.806s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:54 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 is being set with open permissions: ugo+rw Jul 07 17:31:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:54 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 Jul 07 17:31:54 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:55 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" returned: 0 in 0.771s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:55 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=105,cinder:UPDATE=122,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:55 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=107,cinder:UPDATE=105,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.808s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-957cb30f-0e89-48c2-9006-1f2f413a078e tempest-SnapshotsActionsTest-131613167 None] Create snapshot completed successfully Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-64a1b7bb-7f0f-41c3-b39c-80ce39b53d35-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-64a1b7bb-7f0f-41c3-b39c-80ce39b53d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Deleting offline snapshot 64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] snapshot_file for this snap is: volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e32d501-19bb-4874-a484-93e6c677b2a8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:56 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 Jul 07 17:31:56 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:57 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" returned: 0 in 1.131s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:57 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[604ddea8-bafc-4a21-a8f8-6ed3ec4eae1f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:57 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:31:57 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:58 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 1.154s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:58 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 Jul 07 17:31:58 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:59 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Flow 'volume_create_manager' (d6371358-1341-4182-b9f9-90102f04bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a98fda5-ae45-4cc8-a0ee-425b2bf537c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a98fda5-ae45-4cc8-a0ee-425b2bf537c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-232258733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b49a61-d354-490b-a9d4-5fa55ae14f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76dbec781c24a80aed86b617116abc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:00Z,use_quota=True,user_id='ccd1d22b95324950856e309275530301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1139275-036c-44f8-866a-59b7ea07448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1139275-036c-44f8-866a-59b7ea07448f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed90b43-1dfa-4608-bf37-5d510ca53599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed90b43-1dfa-4608-bf37-5d510ca53599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b49a61-d354-490b-a9d4-5fa55ae14f67', 'volume_name': 'volume-63b49a61-d354-490b-a9d4-5fa55ae14f67', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa6a863-c2ea-469c-861e-0ccf88aa2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa6a863-c2ea-469c-861e-0ccf88aa2122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f00389-ceee-444f-b9c3-05740b6746da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Volume 63b49a61-d354-490b-a9d4-5fa55ae14f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b49a61-d354-490b-a9d4-5fa55ae14f67', 'volume_size': 1} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-232258733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b49a61-d354-490b-a9d4-5fa55ae14f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76dbec781c24a80aed86b617116abc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:00Z,use_quota=True,user_id='ccd1d22b95324950856e309275530301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Creating volume 63b49a61-d354-490b-a9d4-5fa55ae14f67 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:00 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 1073741824 Jul 07 17:32:00 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:00 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" returned: 0 in 1.770s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:00 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35 Jul 07 17:32:00 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:01 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" returned: 0 in 1.391s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca9f967e-f24a-4f65-944e-547d911d674b tempest-VolumesActionsTest-740516094 None] Acquiring lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4" by "attach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-64a1b7bb-7f0f-41c3-b39c-80ce39b53d35" released by "_delete_snapshot" :: held 5.677s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" released by "delete_snapshot" :: held 5.728s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca9f967e-f24a-4f65-944e-547d911d674b tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4" acquired by "attach_volume" :: waited 0.060s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ca9f967e-f24a-4f65-944e-547d911d674b tempest-VolumesActionsTest-740516094 None] Attaching volume 8905adc5-acd1-457e-9796-4863469dc5a4 to instance 0aa46485-b45c-4234-a6cb-c39977059646 at mountpoint /dev/vdb on host None. Jul 07 17:32:02 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 1073741824" returned: 0 in 1.961s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Created reservations ['6d14a80e-f55c-43f3-968c-09f4a949ad55', '9c20a18c-7024-4d55-8c0c-a83888f89aaa', '345c5055-6bef-44ed-b669-a183c38f8132', 'c6433486-17e1-4800-8ef7-59547c93df86'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ca9f967e-f24a-4f65-944e-547d911d674b tempest-VolumesActionsTest-740516094 None] Attach volume completed successfully. Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca9f967e-f24a-4f65-944e-547d911d674b tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4" released by "attach_volume" :: held 0.349s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:02 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 Jul 07 17:32:02 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Delete snapshot completed successfully. Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-110e143a-6d9a-472f-8a68-78fd003bc47e tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-64a1b7bb-7f0f-41c3-b39c-80ce39b53d35-delete_snapshot" released by "delete_snapshot" :: held 6.291s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cb1b1d4-71a3-44cd-8250-fba477dd8a5a tempest-VolumesActionsTest-740516094 None] Acquiring lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-detach_volume" by "detach_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cb1b1d4-71a3-44cd-8250-fba477dd8a5a tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7cb1b1d4-71a3-44cd-8250-fba477dd8a5a tempest-VolumesActionsTest-740516094 None] Detaching volume 8905adc5-acd1-457e-9796-4863469dc5a4 from instance 0aa46485-b45c-4234-a6cb-c39977059646. Jul 07 17:32:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7cb1b1d4-71a3-44cd-8250-fba477dd8a5a tempest-VolumesActionsTest-740516094 None] Detach volume completed successfully. Jul 07 17:32:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cb1b1d4-71a3-44cd-8250-fba477dd8a5a tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-detach_volume" released by "detach_volume" :: held 0.201s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:03 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67" returned: 0 in 1.438s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] <== create_volume: return (3580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.587s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.325s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Creating offline snapshot 484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f00389-ceee-444f-b9c3-05740b6746da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b49a61-d354-490b-a9d4-5fa55ae14f67', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbcc2b0-2c07-4cb4-82f5-9f2ad218767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd039033-4b2e-4c35-9403-7286c69c63b7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:04 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Volume volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 (63b49a61-d354-490b-a9d4-5fa55ae14f67): created successfully Jul 07 17:32:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbcc2b0-2c07-4cb4-82f5-9f2ad218767f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Flow 'volume_create_manager' (d6371358-1341-4182-b9f9-90102f04bf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3616e5a2-84ad-46d7-96fd-d74b6279a5da tempest-VolumesTransfersTest-1572404538 None] Created volume successfully. Jul 07 17:32:04 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:32:04 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:05 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 1.165s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:05 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 1G Jul 07 17:32:05 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c2a2dfcf-8439-4a95-bdd9-5f471c1c207d tempest-VolumesTransfersTest-835049816 None] Transfer volume completed successfully. Jul 07 17:32:06 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 1G" returned: 0 in 1.259s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:06 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 Jul 07 17:32:06 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Acquiring lock "cinder-63b49a61-d354-490b-a9d4-5fa55ae14f67-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-63b49a61-d354-490b-a9d4-5fa55ae14f67-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Acquiring lock "cinder-quobyte-63b49a61-d354-490b-a9d4-5fa55ae14f67" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-quobyte-63b49a61-d354-490b-a9d4-5fa55ae14f67" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad3c5c-1115-4049-9f5b-7addecbc92fa]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:07 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 Jul 07 17:32:07 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:07 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" returned: 0 in 1.056s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:07 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 is being set with open permissions: ugo+rw Jul 07 17:32:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:07 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 Jul 07 17:32:07 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:08 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67" returned: 0 in 0.805s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:08 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67 Jul 07 17:32:08 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:08 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" returned: 0 in 0.750s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.470s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b7cfe2b3-8776-4291-9628-a69051513fc1 tempest-SnapshotsActionsTest-131613167 None] Create snapshot completed successfully Jul 07 17:32:08 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-63b49a61-d354-490b-a9d4-5fa55ae14f67" returned: 0 in 0.760s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-quobyte-63b49a61-d354-490b-a9d4-5fa55ae14f67" released by "delete_volume" :: held 1.634s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:08 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Created reservations ['45d437e6-5362-4b52-a97b-59d3572ec060', '8b514073-a1fb-4796-8281-20798169b709', '35d57fa9-7387-4359-be65-1b823a980cd1', 'ccfd02b6-7f2d-4f66-8fbc-db9ef6abcc3f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-484f0fc1-3fbc-46a8-b36b-319e3e3c76f4-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-484f0fc1-3fbc-46a8-b36b-319e3e3c76f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:09 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:32:09 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Deleting offline snapshot 484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] snapshot_file for this snap is: volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a46aa6-1e04-4d44-842c-a752f7d4f4bc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 Jul 07 17:32:09 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:10 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.967s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Deleted volume successfully. Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Flow 'volume_create_manager' (cc3ad064-fa48-45ae-91a4-1403e4d82a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71002dc6-59cc-4d32-a0b6-4be958d9ad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7ad1e048-aebf-4e5f-b689-f5fe5a6b0bc5 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-63b49a61-d354-490b-a9d4-5fa55ae14f67-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71002dc6-59cc-4d32-a0b6-4be958d9ad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-987146752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3441f7d2-a6f7-4573-9939-46045fd31942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76dbec781c24a80aed86b617116abc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:10Z,use_quota=True,user_id='ccd1d22b95324950856e309275530301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c24408d-2d87-4d7c-93fc-f23dd1570840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c24408d-2d87-4d7c-93fc-f23dd1570840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd258aaf-e076-4297-a6ef-8052abf6a5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd258aaf-e076-4297-a6ef-8052abf6a5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3441f7d2-a6f7-4573-9939-46045fd31942', 'volume_name': 'volume-3441f7d2-a6f7-4573-9939-46045fd31942', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b5c36c-e1e3-44c7-ac7c-69541d320aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b5c36c-e1e3-44c7-ac7c-69541d320aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b3717-34e0-42c6-84cc-7a41c0ad59fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:10 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Volume 3441f7d2-a6f7-4573-9939-46045fd31942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3441f7d2-a6f7-4573-9939-46045fd31942', 'volume_size': 1} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-987146752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3441f7d2-a6f7-4573-9939-46045fd31942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76dbec781c24a80aed86b617116abc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:10Z,use_quota=True,user_id='ccd1d22b95324950856e309275530301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Creating volume 3441f7d2-a6f7-4573-9939-46045fd31942 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:10 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:10 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 1073741824 Jul 07 17:32:10 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:10 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" returned: 0 in 1.167s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c358c6-f9dd-49bb-a3ff-9d6e24663b1c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:10 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:32:10 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 1073741824" returned: 0 in 0.978s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:11 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 Jul 07 17:32:11 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 1.037s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:11 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 Jul 07 17:32:11 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:12 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942" returned: 0 in 0.881s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b3717-34e0-42c6-84cc-7a41c0ad59fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3441f7d2-a6f7-4573-9939-46045fd31942', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461ae3db-c7c8-4d17-b0ae-87ac98d1afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Volume volume-3441f7d2-a6f7-4573-9939-46045fd31942 (3441f7d2-a6f7-4573-9939-46045fd31942): created successfully Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461ae3db-c7c8-4d17-b0ae-87ac98d1afd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Flow 'volume_create_manager' (cc3ad064-fa48-45ae-91a4-1403e4d82a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:12 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d7c31dc8-bedf-470d-915c-dbe2b06f0d23 tempest-VolumesTransfersTest-1572404538 None] Created volume successfully. Jul 07 17:32:12 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" returned: 0 in 1.338s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:12 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4 Jul 07 17:32:12 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd47a7d-17a3-43ba-b735-2ac83e6cd6f7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:32:13 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Acquiring lock "cinder-3441f7d2-a6f7-4573-9939-46045fd31942-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-3441f7d2-a6f7-4573-9939-46045fd31942-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Acquiring lock "cinder-quobyte-3441f7d2-a6f7-4573-9939-46045fd31942" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-quobyte-3441f7d2-a6f7-4573-9939-46045fd31942" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[42415a6c-036b-4ba7-9ab9-8c4e15c54722]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" returned: 0 in 1.111s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-484f0fc1-3fbc-46a8-b36b-319e3e3c76f4" released by "_delete_snapshot" :: held 4.794s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" released by "delete_snapshot" :: held 4.829s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:13 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 Jul 07 17:32:13 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:14 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Created reservations ['1b744824-4a51-48e5-ab61-221563dcf27b', 'e00f95e8-5a26-4938-a201-062f7b66ff9c', 'a49d470b-8c05-41b8-b229-ad93af8cec7f', 'cbe0b579-44dd-42b3-a874-7ff3f9765e19'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Delete snapshot completed successfully. Jul 07 17:32:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-90cf7c29-725d-45cf-9e1c-d18b6c934545 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-484f0fc1-3fbc-46a8-b36b-319e3e3c76f4-delete_snapshot" released by "delete_snapshot" :: held 5.093s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:14 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 1.157s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a243b4-84cf-4799-88a4-5fdcc649fe49]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:14 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:32:14 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:15 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942" returned: 0 in 1.273s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942 Jul 07 17:32:15 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 1.221s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.80e68664-46c4-48a0-98aa-cb3527dc15650_wjpd35.img {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.80e68664-46c4-48a0-98aa-cb3527dc15650_wjpd35.img Jul 07 17:32:15 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3441f7d2-a6f7-4573-9939-46045fd31942" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-quobyte-3441f7d2-a6f7-4573-9939-46045fd31942" released by "delete_volume" :: held 2.077s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Created reservations ['0d16d35d-5b3f-432e-9dd5-679857a2ba20', 'ee0db784-d005-470e-8750-740dda5aa86d', 'db73558c-3c2c-43dc-9913-d7bc7dc395a8', '690dc640-ac61-4d17-adb6-26a6d385776a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:32:15 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:16 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.997s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Deleted volume successfully. Jul 07 17:32:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d4ce0234-1e92-42c2-8879-ba9b30e8ea73 tempest-VolumesTransfersTest-802615283 None] Lock "cinder-3441f7d2-a6f7-4573-9939-46045fd31942-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:21 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.80e68664-46c4-48a0-98aa-cb3527dc15650_wjpd35.img" returned: 0 in 5.518s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b33732-10ba-4761-b168-324689c07e57]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:21 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:32:21 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:22 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 1.040s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:22 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.80e68664-46c4-48a0-98aa-cb3527dc15650_wjpd35.img {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:32:22 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Converted 1024.00 MB image at 185.53 MB/s Jul 07 17:32:22 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] 80e68664-46c4-48a0-98aa-cb3527dc1565 was raw, no need to convert to raw {{(pid=87251) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Flow 'volume_create_manager' (3513f09a-340b-4fb9-8d0d-53be015a80aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cc108d-877b-4236-afd6-63c5866fc878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cc108d-877b-4236-afd6-63c5866fc878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-571787937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e124aa12-439b-4fdf-8f94-cd776d2d9b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93517158bcb34c50b70319273d76d28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:28Z,use_quota=True,user_id='3f10f2b20e5d42f99f2d5fd0b5d48ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5827019c-9123-49a4-a410-d11237f6c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5827019c-9123-49a4-a410-d11237f6c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7756abcf-5151-415c-9430-e0e73dc36bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7756abcf-5151-415c-9430-e0e73dc36bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e124aa12-439b-4fdf-8f94-cd776d2d9b2e', 'volume_name': 'volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d78d47-a550-4958-888a-1a1b214483c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d78d47-a550-4958-888a-1a1b214483c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587f7095-5d23-4557-bb0a-bc380c1cb26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:28 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Volume e124aa12-439b-4fdf-8f94-cd776d2d9b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e', 'volume_size': 1} Jul 07 17:32:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:32 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:32:32 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:33 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.773s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:32:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:32:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:32:38 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=41,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:32:38 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=39,cinder:SELECT=32,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:32:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.351s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Uploaded volume to glance image-id: 80e68664-46c4-48a0-98aa-cb3527dc1565. {{(pid=87251) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 17:32:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.592s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Creating offline snapshot 3d214738-ebd5-41f8-826f-134572c4ef99 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:44 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b271c10c-e4d6-452a-a60e-a21e9e1d3138 tempest-VolumesActionsTest-740516094 None] Copy volume to image completed successfully. Jul 07 17:32:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a0e238-2681-4bee-8845-dc08dfa56bd5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:44 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:32:44 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:45 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.754s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:45 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 1G Jul 07 17:32:45 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:46 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 1G" returned: 0 in 0.953s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:46 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 Jul 07 17:32:46 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:47 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99" returned: 0 in 0.725s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:47 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 is being set with open permissions: ugo+rw Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:47 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 Jul 07 17:32:47 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:47 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99" returned: 0 in 0.678s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.224s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.710s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-571787937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e124aa12-439b-4fdf-8f94-cd776d2d9b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93517158bcb34c50b70319273d76d28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:28Z,use_quota=True,user_id='3f10f2b20e5d42f99f2d5fd0b5d48ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Creating volume e124aa12-439b-4fdf-8f94-cd776d2d9b2e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:47 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:32:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:47 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e 1073741824 Jul 07 17:32:47 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-af7beb20-e6d0-4c11-84b3-1f80ce5b5d97 tempest-SnapshotsActionsTest-131613167 None] Create snapshot completed successfully Jul 07 17:32:48 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e 1073741824" returned: 0 in 0.904s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:48 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e Jul 07 17:32:48 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-3d214738-ebd5-41f8-826f-134572c4ef99-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-3d214738-ebd5-41f8-826f-134572c4ef99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-3d214738-ebd5-41f8-826f-134572c4ef99" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-3d214738-ebd5-41f8-826f-134572c4ef99" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Deleting offline snapshot 3d214738-ebd5-41f8-826f-134572c4ef99 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] snapshot_file for this snap is: volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25e323-1d63-4702-9d7d-b5cb1006f1c8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:49 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 Jul 07 17:32:49 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:49 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e" returned: 0 in 0.705s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.766s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587f7095-5d23-4557-bb0a-bc380c1cb26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486050ef-c840-4729-a4bd-3cd3b648e0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e01f23-6086-4f47-8be9-3b6b477f23ae]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Volume volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e (e124aa12-439b-4fdf-8f94-cd776d2d9b2e): created successfully Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486050ef-c840-4729-a4bd-3cd3b648e0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Flow 'volume_create_manager' (3513f09a-340b-4fb9-8d0d-53be015a80aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-95d09d93-1fdb-432a-bd87-033165589890 tempest-VolumesTransfersV357Test-1588576508 None] Created volume successfully. Jul 07 17:32:49 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:32:49 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:49 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99" returned: 0 in 0.841s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5f58b-b0f2-4133-a66f-711e3e207933]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:49 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:32:49 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:50 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 0.937s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7123af15-9d7b-4554-91ed-0f6dbcc2207c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:50 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:32:50 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:50 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.908s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:50 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 Jul 07 17:32:50 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:51 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 0.988s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:51 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img Jul 07 17:32:51 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9d10d969-d33b-4e29-8047-9495b016c352 tempest-VolumesTransfersV357Test-1916423531 None] Transfer volume completed successfully. Jul 07 17:32:51 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99" returned: 0 in 1.058s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:51 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99 Jul 07 17:32:51 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:52 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.3d214738-ebd5-41f8-826f-134572c4ef99" returned: 0 in 0.986s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-3d214738-ebd5-41f8-826f-134572c4ef99" released by "_delete_snapshot" :: held 3.952s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" released by "delete_snapshot" :: held 3.993s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Acquiring lock "cinder-e124aa12-439b-4fdf-8f94-cd776d2d9b2e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-e124aa12-439b-4fdf-8f94-cd776d2d9b2e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Created reservations ['893a35a4-79ec-4502-983f-fa9de681f15b', '20a327a1-4584-43c5-8f42-f28c65ec8e82', '8b15aa2f-09de-47ff-b656-1e17bd7dcef1', 'eaf58766-1ea0-4c77-af6a-a8e6c5b66be3'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Acquiring lock "cinder-quobyte-e124aa12-439b-4fdf-8f94-cd776d2d9b2e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-quobyte-e124aa12-439b-4fdf-8f94-cd776d2d9b2e" acquired by "delete_volume" :: waited 0.047s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d008fd-0288-48ba-88b7-02253960d35e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Delete snapshot completed successfully. Jul 07 17:32:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b3f56e9-856d-407e-b664-2e15081dc198 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-3d214738-ebd5-41f8-826f-134572c4ef99-delete_snapshot" released by "delete_snapshot" :: held 4.473s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:53 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e Jul 07 17:32:53 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:54 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e" returned: 0 in 1.788s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:55 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e Jul 07 17:32:55 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e124aa12-439b-4fdf-8f94-cd776d2d9b2e" returned: 0 in 1.103s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-quobyte-e124aa12-439b-4fdf-8f94-cd776d2d9b2e" released by "delete_volume" :: held 2.985s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Created reservations ['17fc6370-9d3b-40e9-942e-2a8b0c0e5725', '16eaae82-7e48-4261-bb34-05b6cd2a94b0', 'd731abd3-bb36-4ae1-b95d-4592e6bb2606', '9b9cd2db-538e-41a8-b4c4-187b3a27f229'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:56 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:32:56 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:57 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img" returned: 0 in 5.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4468f8f7-476b-44b1-8751-ec25c9b44807]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:57 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:32:57 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:57 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.188s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Deleted volume successfully. Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e527bb07-3c92-4b22-97a9-815ad2e1cf10 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-e124aa12-439b-4fdf-8f94-cd776d2d9b2e-delete_volume" released by "delete_volume" :: held 4.645s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Flow 'volume_create_manager' (f76b880c-0b18-4d74-8741-54a4c8e739ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44549d-43e2-4544-8279-a1942684a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44549d-43e2-4544-8279-a1942684a27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-116100806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93517158bcb34c50b70319273d76d28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:58Z,use_quota=True,user_id='3f10f2b20e5d42f99f2d5fd0b5d48ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8112179b-4666-4e83-886f-2064ba794284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8112179b-4666-4e83-886f-2064ba794284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a32486-d2c8-4ba8-a6cc-62ea849eb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a32486-d2c8-4ba8-a6cc-62ea849eb88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7', 'volume_name': 'volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0435b78-a01a-46b8-90f5-ca5a91b7e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0435b78-a01a-46b8-90f5-ca5a91b7e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21356ab4-4774-41a7-bc08-0ab41d71f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Volume 6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7', 'volume_size': 1} Jul 07 17:32:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:58 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 1.098s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:58 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:32:58 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Converted 1024.00 MB image at 176.20 MB/s Jul 07 17:32:58 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] 337c4cf1-97ea-4f31-889d-f116c4af0712 was raw, converting to qcow2 {{(pid=87251) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 17:32:58 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4df7fc-a9e4-462d-9d4d-7bd0439284e5]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:58 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img Jul 07 17:32:58 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:59 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:59 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img Jul 07 17:32:59 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:59 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img" returned: 1 in 0.714s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:32:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:59 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq Jul 07 17:32:59 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:00 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq" returned: 0 in 0.641s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:00 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Image conversion details: src /opt/stack/data/cinder/conversion/8905adc5-acd1-457e-9796-4863469dc5a4.temp_image.337c4cf1-97ea-4f31-889d-f116c4af0712w6z11ylq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:33:00 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 17:33:00 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5fad1-6dd4-4a4b-8bf0-b24acb8a9627]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:00 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq Jul 07 17:33:00 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:01 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_twpb9uaq" returned: 0 in 0.765s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Flow 'volume_create_manager' (881bc4d0-ed68-49b4-8d73-6b27802a3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8428370-4a7a-482d-9110-6fc29982b3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8428370-4a7a-482d-9110-6fc29982b3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2047804240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00b412e-b274-472f-a36a-763f9e53cf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36898067395a443c924ee47a36126175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:03Z,use_quota=True,user_id='d029717402ae4b85a4306e653897d76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f8238-c758-4a08-a6b9-42d16941247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f8238-c758-4a08-a6b9-42d16941247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a15f17-ce1e-4edf-8681-7a10deacdf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a15f17-ce1e-4edf-8681-7a10deacdf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00b412e-b274-472f-a36a-763f9e53cf76', 'volume_name': 'volume-a00b412e-b274-472f-a36a-763f9e53cf76', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b43849c-5b11-4644-82ed-ef428fb9e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b43849c-5b11-4644-82ed-ef428fb9e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5886f5-9c5c-44c1-a1cb-caf1b4039a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Volume a00b412e-b274-472f-a36a-763f9e53cf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00b412e-b274-472f-a36a-763f9e53cf76', 'volume_size': 1} Jul 07 17:33:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.531s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Uploaded volume to glance image-id: 337c4cf1-97ea-4f31-889d-f116c4af0712. {{(pid=87251) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.786s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Creating offline snapshot c9265eef-feda-4020-b59b-ea2981d94c24 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:03 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d6d752cb-2f4b-49ba-8c2f-3a76eb157426 tempest-VolumesActionsTest-740516094 None] Copy volume to image completed successfully. Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8e507-e06c-43c5-9da9-ad846b38fe99]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:03 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:33:03 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:03 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.846s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:03 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 1G Jul 07 17:33:03 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Acquiring lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Acquiring lock "cinder-quobyte-8905adc5-acd1-457e-9796-4863469dc5a4" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Lock "cinder-quobyte-8905adc5-acd1-457e-9796-4863469dc5a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068205d-3a75-4227-aa2f-bff0e901c492]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:04 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:33:04 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:04 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 1G" returned: 0 in 1.000s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:04 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 Jul 07 17:33:04 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:05 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 0.920s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:05 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4 Jul 07 17:33:05 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:05 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24" returned: 0 in 0.685s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:05 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 is being set with open permissions: ugo+rw Jul 07 17:33:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:05 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 Jul 07 17:33:05 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:06 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8905adc5-acd1-457e-9796-4863469dc5a4" returned: 0 in 0.759s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Lock "cinder-quobyte-8905adc5-acd1-457e-9796-4863469dc5a4" released by "delete_volume" :: held 1.726s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Created reservations ['53e8e398-7979-413b-b5bf-7d266571d599', '0abf3a41-3924-435e-ace4-9977d682404c', '26edbfab-a130-44e2-b904-543928e7c8ba', '18d2d521-ec35-4b90-bef8-e1b82ec109b0'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:06 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:06 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:06 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24" returned: 0 in 0.659s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.311s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.513s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-116100806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93517158bcb34c50b70319273d76d28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:58Z,use_quota=True,user_id='3f10f2b20e5d42f99f2d5fd0b5d48ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Creating volume 6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:06 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:06 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 1073741824 Jul 07 17:33:06 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0cf1213e-898b-4d49-ac2b-2410e4f04ce4 tempest-SnapshotsActionsTest-131613167 None] Create snapshot completed successfully Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-c9265eef-feda-4020-b59b-ea2981d94c24-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-c9265eef-feda-4020-b59b-ea2981d94c24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Acquiring lock "cinder-quobyte-c9265eef-feda-4020-b59b-ea2981d94c24" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:07 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.843s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-c9265eef-feda-4020-b59b-ea2981d94c24" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Deleting offline snapshot c9265eef-feda-4020-b59b-ea2981d94c24 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] snapshot_file for this snap is: volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Deleted volume successfully. Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e5205c-9527-46b1-a335-8731acec54fd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6072934a-b6e6-40f4-b857-9b6ee6b3acd8 tempest-VolumesActionsTest-740516094 None] Lock "cinder-8905adc5-acd1-457e-9796-4863469dc5a4-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:07 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 Jul 07 17:33:07 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:07 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 1073741824" returned: 0 in 1.003s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:07 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 Jul 07 17:33:07 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:08 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7" returned: 0 in 0.729s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.342s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2047804240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00b412e-b274-472f-a36a-763f9e53cf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36898067395a443c924ee47a36126175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:03Z,use_quota=True,user_id='d029717402ae4b85a4306e653897d76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Creating volume a00b412e-b274-472f-a36a-763f9e53cf76 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:08 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:08 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24" returned: 0 in 0.975s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:08 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 1073741824 Jul 07 17:33:08 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21356ab4-4774-41a7-bc08-0ab41d71f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b3cadf-5ec0-4f89-b0ae-e340ed9b0739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd1f44-9627-4445-b257-61af7b145309]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Volume volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 (6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7): created successfully Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b3cadf-5ec0-4f89-b0ae-e340ed9b0739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Flow 'volume_create_manager' (f76b880c-0b18-4d74-8741-54a4c8e739ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-64235069-91f4-4868-b580-2c6f056cfad2 tempest-VolumesTransfersV357Test-1588576508 None] Created volume successfully. Jul 07 17:33:08 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:33:08 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:09 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 1073741824" returned: 0 in 1.016s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:09 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.978s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:09 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 Jul 07 17:33:09 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:09 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 Jul 07 17:33:09 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Acquiring lock "cinder-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Acquiring lock "cinder-quobyte-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-quobyte-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac967290-bf00-4524-a649-631e4bde0282]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76" returned: 0 in 1.025s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5886f5-9c5c-44c1-a1cb-caf1b4039a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00b412e-b274-472f-a36a-763f9e53cf76', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1aa3623-79d5-4088-b618-43d72febbd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:10 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Volume volume-a00b412e-b274-472f-a36a-763f9e53cf76 (a00b412e-b274-472f-a36a-763f9e53cf76): created successfully Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1aa3623-79d5-4088-b618-43d72febbd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Flow 'volume_create_manager' (881bc4d0-ed68-49b4-8d73-6b27802a3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:10 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 Jul 07 17:33:10 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8f45f513-9f9c-4c70-9659-f26021f7b8b8 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Created volume successfully. Jul 07 17:33:10 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24" returned: 0 in 1.253s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24 Jul 07 17:33:10 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7" returned: 0 in 0.932s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:11 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7 Jul 07 17:33:11 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.c9265eef-feda-4020-b59b-ea2981d94c24" returned: 0 in 0.907s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-c9265eef-feda-4020-b59b-ea2981d94c24" released by "_delete_snapshot" :: held 4.305s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" released by "delete_snapshot" :: held 4.349s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Created reservations ['defb72e0-1710-42fc-b5ee-6ad3d44f6930', '067730da-e03d-4636-b387-9c05eda731bc', '6b40de3a-f83e-4c25-856f-4fd314275fbb', '37b71b8d-57c1-4359-acf6-a24bfe02b321'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Delete snapshot completed successfully. Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b798ad3e-a87b-409a-9ae3-ac073db772e6 tempest-SnapshotsActionsTest-1460021690 None] Lock "cinder-c9265eef-feda-4020-b59b-ea2981d94c24-delete_snapshot" released by "delete_snapshot" :: held 4.557s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7" returned: 0 in 0.864s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-quobyte-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7" released by "delete_volume" :: held 1.911s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Created reservations ['8e81b0e7-6b9a-4e01-9dea-86de3ea0916d', '2f3654df-dd3e-42a8-91b5-bf0488744a30', 'f73b9425-0508-4a0c-8032-773ee815a95f', '32571737-fb5b-412d-bee1-82aa72290e7b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:12 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:12 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "cinder-bca585b5-be22-4fe8-90ed-9dd0cc320d50-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-bca585b5-be22-4fe8-90ed-9dd0cc320d50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "cinder-quobyte-bca585b5-be22-4fe8-90ed-9dd0cc320d50" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-quobyte-bca585b5-be22-4fe8-90ed-9dd0cc320d50" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Deleting offline snapshot bca585b5-be22-4fe8-90ed-9dd0cc320d50 of volume 1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] snapshot_file for this snap is: volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:13 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.939s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Deleted volume successfully. Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1fbdc-0327-48c3-9c1b-0268c996fd3a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b30ef071-35e5-48be-9cdd-f53f39d62e99 tempest-VolumesTransfersV357Test-375102688 None] Lock "cinder-6a54c3d2-51ad-4a0a-94b3-4014ec9e35a7-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:13 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:33:13 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:14 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.931s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[484d28b2-2694-46ec-bf8f-5f29a75e2a9d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:14 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f Jul 07 17:33:14 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4526d3-5572-413c-ac94-b96692417717]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:15 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 Jul 07 17:33:15 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (870adf47-5ec8-400d-bda5-aa5951627695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec708ba0-6169-4a2a-bf8e-4007b8c06096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec708ba0-6169-4a2a-bf8e-4007b8c06096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134302998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c370c1ba-9db0-4153-ae81-6209b4339894,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:15Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838b610e-fa8e-4441-9cf4-5955311e2b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838b610e-fa8e-4441-9cf4-5955311e2b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:15 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce3b2ec-d417-4984-b99c-41e0f7e6dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce3b2ec-d417-4984-b99c-41e0f7e6dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c370c1ba-9db0-4153-ae81-6209b4339894', 'volume_name': 'volume-c370c1ba-9db0-4153-ae81-6209b4339894', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13108d87-2dca-42f5-ba3d-4cc763096574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13108d87-2dca-42f5-ba3d-4cc763096574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0db83b-c5cd-4414-8ea9-db760c33cef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:15 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Volume c370c1ba-9db0-4153-ae81-6209b4339894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c370c1ba-9db0-4153-ae81-6209b4339894', 'volume_size': 1} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" returned: 0 in 1.304s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:15 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:33:15 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76" returned: 0 in 1.121s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134302998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c370c1ba-9db0-4153-ae81-6209b4339894,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:15Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Creating volume c370c1ba-9db0-4153-ae81-6209b4339894 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:16 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:16 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 1073741824 Jul 07 17:33:16 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-a00b412e-b274-472f-a36a-763f9e53cf76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cddd18f6-5919-4540-8208-4491522a4a81', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:33:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-b0f4d508-3692-44c8-8e2d-deaad5ff918a req-353b343d-663a-4ac3-893c-142db17e044a tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] attachment_update completed successfully. Jul 07 17:33:16 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.948s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:16 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50 Jul 07 17:33:16 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 1073741824" returned: 0 in 1.164s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:17 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f.bca585b5-be22-4fe8-90ed-9dd0cc320d50" returned: 0 in 0.901s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:17 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 Jul 07 17:33:17 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-quobyte-bca585b5-be22-4fe8-90ed-9dd0cc320d50" released by "_delete_snapshot" :: held 4.284s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" released by "delete_snapshot" :: held 4.322s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Created reservations ['080dd1be-55bf-44e4-9364-bf8e273e7a27', 'fe621291-6089-4663-90f7-9e76e22c005e', '8502e27c-08fb-48f6-938d-61fd0dfa6b3a', 'dde979a4-eabc-4dd2-a659-5e8477a714a1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Delete snapshot completed successfully. Jul 07 17:33:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-158da26f-0637-492f-968f-fbec744f9477 tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-bca585b5-be22-4fe8-90ed-9dd0cc320d50-delete_snapshot" released by "delete_snapshot" :: held 4.521s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:18 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0db83b-c5cd-4414-8ea9-db760c33cef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c370c1ba-9db0-4153-ae81-6209b4339894', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06446dc8-2e79-4eb6-bcde-d227753c7339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Volume volume-c370c1ba-9db0-4153-ae81-6209b4339894 (c370c1ba-9db0-4153-ae81-6209b4339894): created successfully Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06446dc8-2e79-4eb6-bcde-d227753c7339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (870adf47-5ec8-400d-bda5-aa5951627695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f08a3ee7-b2ee-48af-8cd9-8c3056c07b4a tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "cinder-1bfa5527-3713-4c2b-a6f0-b20096e1e01f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-1bfa5527-3713-4c2b-a6f0-b20096e1e01f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557945e-e9b1-4180-b9c9-51bcdd5aa9c8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:18 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f Jul 07 17:33:18 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (8d027ced-adf7-4cfb-8278-4275dc96b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3731134-7952-4248-a961-e3159c5406cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3731134-7952-4248-a961-e3159c5406cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2074725861',display_name='tempest-VolumesGetTest-Volume-535666582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d36bfb1-79fc-4807-a21f-36fa54865db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:19Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc17d2c4-a29b-4a03-a974-d59f64593eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc17d2c4-a29b-4a03-a974-d59f64593eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f06725-db93-42c0-8dc4-40eed96b81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f06725-db93-42c0-8dc4-40eed96b81c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d36bfb1-79fc-4807-a21f-36fa54865db8', 'volume_name': 'volume-9d36bfb1-79fc-4807-a21f-36fa54865db8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3837abcd-ea43-4018-b965-cbeff15b7e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3837abcd-ea43-4018-b965-cbeff15b7e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b41a91a-5586-414d-9175-4467d020f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:19 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Volume 9d36bfb1-79fc-4807-a21f-36fa54865db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d36bfb1-79fc-4807-a21f-36fa54865db8', 'volume_size': 1} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2074725861',display_name='tempest-VolumesGetTest-Volume-535666582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d36bfb1-79fc-4807-a21f-36fa54865db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:19Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Creating volume 9d36bfb1-79fc-4807-a21f-36fa54865db8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:19 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:19 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 1073741824 Jul 07 17:33:19 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:19 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" returned: 0 in 0.969s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:19 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f Jul 07 17:33:19 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Flow 'volume_create_manager' (f3e06040-8d2e-40bf-b09e-da4cb23f14be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1663c227-e381-46bb-8a0e-bbb35961aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1663c227-e381-46bb-8a0e-bbb35961aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-609349426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4091ff06-b198-4b13-9909-17905e055733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154fff151cd434f834f92dcce02715d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:20Z,use_quota=True,user_id='b297a338a6e84b3a816040131d5d45db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02caacdb-1925-411f-aaea-751977d9c81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02caacdb-1925-411f-aaea-751977d9c81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e56bce-4f3a-4284-abe7-35c2af0264b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e56bce-4f3a-4284-abe7-35c2af0264b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4091ff06-b198-4b13-9909-17905e055733', 'volume_name': 'volume-4091ff06-b198-4b13-9909-17905e055733', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8d48e3-cb85-4c06-b2d5-b1f6fce07973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8d48e3-cb85-4c06-b2d5-b1f6fce07973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f389cd6d-8a2a-4609-87ef-ae3267aed1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:20 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Volume 4091ff06-b198-4b13-9909-17905e055733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4091ff06-b198-4b13-9909-17905e055733', 'volume_size': 1} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:20 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" returned: 0 in 1.000s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:20 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 1073741824" returned: 0 in 1.150s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-quobyte-1bfa5527-3713-4c2b-a6f0-b20096e1e01f" released by "delete_volume" :: held 2.064s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:20 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 Jul 07 17:33:20 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Created reservations ['4283bf97-aad0-4581-8236-5cfbeeaa7f3f', '70075fd2-4d1f-4093-abfb-7f337bdb4e58', '2231c6ca-3124-420f-a8fa-7f0cf5f06a84', 'c40d3ec6-a3ab-4b10-89cd-76135aaac1e3'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:20 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:20 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:21 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8" returned: 0 in 0.909s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-609349426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4091ff06-b198-4b13-9909-17905e055733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154fff151cd434f834f92dcce02715d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:20Z,use_quota=True,user_id='b297a338a6e84b3a816040131d5d45db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Creating volume 4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:21 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:21 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 1073741824 Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b41a91a-5586-414d-9175-4467d020f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d36bfb1-79fc-4807-a21f-36fa54865db8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:21 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d75681-f0cf-4640-9c93-fe187a9e7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:21 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Volume volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 (9d36bfb1-79fc-4807-a21f-36fa54865db8): created successfully Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d75681-f0cf-4640-9c93-fe187a9e7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (8d027ced-adf7-4cfb-8278-4275dc96b9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b32adc7d-ae06-4b1d-80d1-146e64bc9a90 tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:33:21 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.957s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Deleted volume successfully. Jul 07 17:33:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feea6638-8b66-4be1-8886-cd5f7d8a72ff tempest-SnapshotsActionsTest-131613167 None] Lock "cinder-1bfa5527-3713-4c2b-a6f0-b20096e1e01f-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-9d36bfb1-79fc-4807-a21f-36fa54865db8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:22 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 1073741824" returned: 0 in 1.393s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Lock "cinder-9d36bfb1-79fc-4807-a21f-36fa54865db8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-9d36bfb1-79fc-4807-a21f-36fa54865db8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:23 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:23 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-9d36bfb1-79fc-4807-a21f-36fa54865db8" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f20e1-a620-4473-9a1a-dc8b850b9592]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:23 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 Jul 07 17:33:23 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:23 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 0.768s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f389cd6d-8a2a-4609-87ef-ae3267aed1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4091ff06-b198-4b13-9909-17905e055733', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef20d05-a5a1-4876-b7d3-906c3c64e313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:23 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Volume volume-4091ff06-b198-4b13-9909-17905e055733 (4091ff06-b198-4b13-9909-17905e055733): created successfully Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef20d05-a5a1-4876-b7d3-906c3c64e313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Flow 'volume_create_manager' (f3e06040-8d2e-40bf-b09e-da4cb23f14be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-442959c3-180a-45a4-97d8-4c04a0d65cc7 tempest-VolumesCloneTest-1434206888 None] Created volume successfully. Jul 07 17:33:24 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8" returned: 0 in 1.032s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:24 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8 Jul 07 17:33:24 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-f5328726-ce71-4784-b0b1-2e58f044c265 req-fa22d276-5ffc-4ab8-a1ff-3fae62c86681 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Terminate volume connection completed successfully. Jul 07 17:33:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-f5328726-ce71-4784-b0b1-2e58f044c265 req-fa22d276-5ffc-4ab8-a1ff-3fae62c86681 tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Deleting attachment cddd18f6-5919-4540-8208-4491522a4a81. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:33:25 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9d36bfb1-79fc-4807-a21f-36fa54865db8" returned: 0 in 0.999s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-9d36bfb1-79fc-4807-a21f-36fa54865db8" released by "delete_volume" :: held 2.087s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Created reservations ['ba591987-860b-4740-b52d-5ba99ab56d77', '1cd5bb74-d6d2-464c-99b5-2d162de3f96b', '729f5ffc-595b-46b6-a790-2d4b453a770b', '80cd6022-5928-424d-902c-91b7141548a5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Flow 'volume_create_manager' (97ce3078-992e-45d9-a7b6-040d2df187f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b169e167-1181-4971-bc5d-cc737a32d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b169e167-1181-4971-bc5d-cc737a32d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1639020105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74d2bb3-8474-4127-a735-c7d2684cd487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154fff151cd434f834f92dcce02715d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4091ff06-b198-4b13-9909-17905e055733,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:25Z,use_quota=True,user_id='b297a338a6e84b3a816040131d5d45db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608ad9d7-27b0-4425-b5d8-695f669d299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608ad9d7-27b0-4425-b5d8-695f669d299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b64f749-8494-4198-9964-0479a8f12be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b64f749-8494-4198-9964-0479a8f12be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd74d2bb3-8474-4127-a735-c7d2684cd487', 'volume_name': 'volume-d74d2bb3-8474-4127-a735-c7d2684cd487', 'volume_size': 2, 'source_volid': '4091ff06-b198-4b13-9909-17905e055733', 'source_volstatus': 'available'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ef9232-d421-4a72-9ea4-4d25bdce114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ef9232-d421-4a72-9ea4-4d25bdce114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ae9c81-d0c3-432c-b6bd-2b6d00179172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:25 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Volume d74d2bb3-8474-4127-a735-c7d2684cd487: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d74d2bb3-8474-4127-a735-c7d2684cd487', 'volume_size': 2, 'source_volid': '4091ff06-b198-4b13-9909-17905e055733', 'source_volstatus': 'available'} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:25 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Cloning volume 4091ff06-b198-4b13-9909-17905e055733 to volume d74d2bb3-8474-4127-a735-c7d2684cd487 Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:25 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:25 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Creating offline snapshot abcf90cd-0cce-4192-9efe-92468dea4a91 of volume 4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3057fe0e-a086-46f6-87f8-b7cf3b38a25e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:25 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:25 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:26 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.750s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dbf40bcf-71a7-43d3-bde4-b8ebb686e6d7 tempest-VolumesGetTest-1781536400 None] Lock "cinder-9d36bfb1-79fc-4807-a21f-36fa54865db8-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:26 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-c370c1ba-9db0-4153-ae81-6209b4339894-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Acquiring lock "cinder-a00b412e-b274-472f-a36a-763f9e53cf76-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:26 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 1G Jul 07 17:33:26 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Lock "cinder-c370c1ba-9db0-4153-ae81-6209b4339894-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "cinder-a00b412e-b274-472f-a36a-763f9e53cf76-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Acquiring lock "cinder-quobyte-a00b412e-b274-472f-a36a-763f9e53cf76" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-c370c1ba-9db0-4153-ae81-6209b4339894" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "cinder-quobyte-a00b412e-b274-472f-a36a-763f9e53cf76" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-c370c1ba-9db0-4153-ae81-6209b4339894" acquired by "delete_volume" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52467e9-752d-4649-8c74-02209775fd54]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9031c-3390-4808-8d57-9c169f1cb811]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:26 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 Jul 07 17:33:26 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:26 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 Jul 07 17:33:26 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 1G" returned: 0 in 1.055s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4091ff06-b198-4b13-9909-17905e055733 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4091ff06-b198-4b13-9909-17905e055733 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 Jul 07 17:33:27 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894" returned: 0 in 0.894s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76" returned: 0 in 0.923s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894 Jul 07 17:33:27 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76 Jul 07 17:33:27 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:28 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a00b412e-b274-472f-a36a-763f9e53cf76" returned: 0 in 0.742s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "cinder-quobyte-a00b412e-b274-472f-a36a-763f9e53cf76" released by "delete_volume" :: held 1.730s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:28 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4091ff06-b198-4b13-9909-17905e055733 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91" returned: 0 in 0.908s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:28 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 is being set with open permissions: ugo+rw Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:28 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 Jul 07 17:33:28 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:28 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Created reservations ['60eba800-c74b-47ea-8b34-4d4c44b09a0d', 'b666048b-121a-4bd8-b6c2-9f0d5446e81e', 'b15352b8-4858-4ed7-8c5b-a6a7742dce5e', 'e927d5b5-6fc8-48fd-b170-e3b93d24d60d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c370c1ba-9db0-4153-ae81-6209b4339894" returned: 0 in 0.918s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-c370c1ba-9db0-4153-ae81-6209b4339894" released by "delete_volume" :: held 1.867s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:28 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Created reservations ['d8e97135-a69e-43c7-ab3d-e00897434ea2', 'acc34bd8-9366-4c8d-bc19-f671c7a77c70', 'af2ea1fb-aa50-48a8-80c0-96c022715567', '5e0ab44b-d2bc-4f9a-9aca-3dd19c7a9406'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:28 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:28 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:28 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:29 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91" returned: 0 in 1.062s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:29 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info Jul 07 17:33:29 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:29 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.006s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:29 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Deleted volume successfully. Jul 07 17:33:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d6cd71c-cc1b-4890-b4e7-838bda217dbc tempest-TestServerVolumeAttachScenarioOldVersion-701426337 None] Lock "cinder-a00b412e-b274-472f-a36a-763f9e53cf76-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (a0584da8-d39f-48ee-96e8-38efd6d93419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9912773-c7e0-4539-80e6-a41ebe40ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9912773-c7e0-4539-80e6-a41ebe40ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-299662577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27fb6fd-de9e-4614-961a-fd7803c1428d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:30Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:30 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18b869e-8f4a-4c5f-86dd-80a4fd7cd04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18b869e-8f4a-4c5f-86dd-80a4fd7cd04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc930a4e-af78-4477-844a-11a7d4dcc25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc930a4e-af78-4477-844a-11a7d4dcc25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27fb6fd-de9e-4614-961a-fd7803c1428d', 'volume_name': 'volume-f27fb6fd-de9e-4614-961a-fd7803c1428d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaff7c0-ae03-4d41-a5c9-1935c32b5da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaff7c0-ae03-4d41-a5c9-1935c32b5da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b05df9-efc3-49ef-87d8-b80a982230ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Volume f27fb6fd-de9e-4614-961a-fd7803c1428d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27fb6fd-de9e-4614-961a-fd7803c1428d', 'volume_size': 1} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.465s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:30 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e1c6c0d-6b49-47d6-b403-cfe3b6d6fbc2 tempest-VolumesGetTest-1781536400 None] Lock "cinder-c370c1ba-9db0-4153-ae81-6209b4339894-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:30 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info" returned: 0 in 1.098s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:30 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info is being set with open permissions: ugo+rw Jul 07 17:33:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:30 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info Jul 07 17:33:30 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:31 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.info" returned: 0 in 0.901s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Acquiring lock "cinder-quobyte-d74d2bb3-8474-4127-a735-c7d2684cd487" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-d74d2bb3-8474-4127-a735-c7d2684cd487" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] snapshot: abcf90cd-0cce-4192-9efe-92468dea4a91, volume: d74d2bb3-8474-4127-a735-c7d2684cd487, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1707a12-a48f-4d5b-ba11-f9f54f94ee04]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:31 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 Jul 07 17:33:31 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:32 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91" returned: 0 in 0.945s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4091ff06-b198-4b13-9909-17905e055733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea35f85-d494-4e18-9507-f2203638ec4b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:32 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:32 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:32 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:32 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:33 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.758s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:33:33 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 0.894s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:33:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:33 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 Jul 07 17:33:33 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:39 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487" returned: 0 in 5.987s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:39 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f08c2f-1aa7-41fd-b101-ae342e9c5e36]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:39 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:39 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:40 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=77,cinder:UPDATE=95,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:33:40 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=82,cinder:UPDATE=96,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:33:40 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 1.153s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:40 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:33:40 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Converted 1024.00 MB image at 171.01 MB/s Jul 07 17:33:40 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 is being set with open permissions: ugo+rw Jul 07 17:33:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:40 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 Jul 07 17:33:40 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:41 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487" returned: 0 in 0.744s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-d74d2bb3-8474-4127-a735-c7d2684cd487" released by "_copy_volume_from_snapshot" :: held 9.829s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Acquiring lock "cinder-quobyte-abcf90cd-0cce-4192-9efe-92468dea4a91" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-abcf90cd-0cce-4192-9efe-92468dea4a91" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Deleting offline snapshot abcf90cd-0cce-4192-9efe-92468dea4a91 of volume 4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] snapshot_file for this snap is: volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[851f7838-c379-49b6-b802-819442a59d52]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:41 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 Jul 07 17:33:41 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Flow 'volume_create_manager' (8becf270-8478-419e-8129-fca6b4050c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ac6205-2ee9-4e54-95a8-1d0eb59f2ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ac6205-2ee9-4e54-95a8-1d0eb59f2ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1362438095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6859f2ce-dbb0-4613-bf0d-cdd10de3c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad31195016a242a8950a88191c4f8e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:42Z,use_quota=True,user_id='b702463aa31d438dad4b9daa2600cd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b048e825-dc85-412c-9af1-7d03dad255bb),volume_type_id=b048e825-dc85-412c-9af1-7d03dad255bb)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8e6d58-b287-4111-ac6e-4d8777964e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8e6d58-b287-4111-ac6e-4d8777964e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ab277a-4fcc-4af4-843e-b343f0ab48f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ab277a-4fcc-4af4-843e-b343f0ab48f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6859f2ce-dbb0-4613-bf0d-cdd10de3c973', 'volume_name': 'volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33158e8-6fbd-4fc7-99f5-77378e0e93c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33158e8-6fbd-4fc7-99f5-77378e0e93c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d946d642-a67e-45f3-ad71-eb42025d3f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Volume 6859f2ce-dbb0-4613-bf0d-cdd10de3c973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973', 'volume_size': 1} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:42 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91" returned: 0 in 0.941s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4091ff06-b198-4b13-9909-17905e055733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a8f53e-208b-48fb-b3cc-bfbaa62ec013]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:42 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:42 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:43 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 0.922s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:43 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 Jul 07 17:33:43 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:44 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91" returned: 0 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:44 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91 Jul 07 17:33:44 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:44 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733.abcf90cd-0cce-4192-9efe-92468dea4a91" returned: 0 in 0.735s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-abcf90cd-0cce-4192-9efe-92468dea4a91" released by "_delete_snapshot" :: held 3.530s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.598s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.768s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-299662577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27fb6fd-de9e-4614-961a-fd7803c1428d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:30Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Creating volume f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:45 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:45 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d 1073741824 Jul 07 17:33:45 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ae9c81-d0c3-432c-b6bd-2b6d00179172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74d2bb3-8474-4127-a735-c7d2684cd487', 'volume_size': 2, 'source_volid': '4091ff06-b198-4b13-9909-17905e055733', 'source_volstatus': 'available'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e25bcb4-6ee4-4cc6-b8cd-c52299b3fdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Volume volume-d74d2bb3-8474-4127-a735-c7d2684cd487 (d74d2bb3-8474-4127-a735-c7d2684cd487): created successfully Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e25bcb4-6ee4-4cc6-b8cd-c52299b3fdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Flow 'volume_create_manager' (97ce3078-992e-45d9-a7b6-040d2df187f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:45 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5e7c37ca-181d-4d34-8982-474f74d17e0a tempest-VolumesCloneTest-1434206888 None] Created volume successfully. Jul 07 17:33:46 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d 1073741824" returned: 0 in 1.079s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:33:46 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "cinder-d74d2bb3-8474-4127-a735-c7d2684cd487-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-d74d2bb3-8474-4127-a735-c7d2684cd487-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "cinder-quobyte-d74d2bb3-8474-4127-a735-c7d2684cd487" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-d74d2bb3-8474-4127-a735-c7d2684cd487" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c5934-02a3-45ea-8e05-e8ae878973d2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 Jul 07 17:33:46 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:46 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 0.770s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.630s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1362438095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6859f2ce-dbb0-4613-bf0d-cdd10de3c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad31195016a242a8950a88191c4f8e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:42Z,use_quota=True,user_id='b702463aa31d438dad4b9daa2600cd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b048e825-dc85-412c-9af1-7d03dad255bb),volume_type_id=b048e825-dc85-412c-9af1-7d03dad255bb)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Creating volume 6859f2ce-dbb0-4613-bf0d-cdd10de3c973 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:47 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:47 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 1073741824 Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b05df9-efc3-49ef-87d8-b80a982230ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27fb6fd-de9e-4614-961a-fd7803c1428d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:47 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d243bb02-23d8-403c-b14f-e6037a7c921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:47 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Volume volume-f27fb6fd-de9e-4614-961a-fd7803c1428d (f27fb6fd-de9e-4614-961a-fd7803c1428d): created successfully Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d243bb02-23d8-403c-b14f-e6037a7c921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (a0584da8-d39f-48ee-96e8-38efd6d93419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1825cf8a-0f7e-49ed-b8aa-7628dfa35cb9 tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:33:47 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487" returned: 0 in 0.973s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:47 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487 Jul 07 17:33:47 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:48 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 1073741824" returned: 0 in 1.215s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:48 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 Jul 07 17:33:48 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:48 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d74d2bb3-8474-4127-a735-c7d2684cd487" returned: 0 in 1.102s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-d74d2bb3-8474-4127-a735-c7d2684cd487" released by "delete_volume" :: held 2.127s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Created reservations ['a34bc3f0-b2ca-4357-a3e1-529250ea66d5', '3e4d753e-61d4-48ca-81e4-34615c7b22ab', '4074d292-3be2-44f7-87bd-713e20435876', 'd4eea2cd-e19e-4046-9850-4d328c79f224'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (cf08a11e-3baf-4900-8177-94ed84bc652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19b52d6-a1f5-4d40-b53a-a2cb9ac51013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19b52d6-a1f5-4d40-b53a-a2cb9ac51013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1284361016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa9c4cd-7c41-4545-a9b2-b9eca0b17126,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f27fb6fd-de9e-4614-961a-fd7803c1428d,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:49Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72106d20-be04-43e7-8f74-26ea4d13de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72106d20-be04-43e7-8f74-26ea4d13de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c10669d-70db-4fab-9715-854c50d2a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c10669d-70db-4fab-9715-854c50d2a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dfa9c4cd-7c41-4545-a9b2-b9eca0b17126', 'volume_name': 'volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126', 'volume_size': 1, 'source_volid': 'f27fb6fd-de9e-4614-961a-fd7803c1428d', 'source_volstatus': 'available'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7bc247-16d8-4bb6-ab64-7dbad9c25436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7bc247-16d8-4bb6-ab64-7dbad9c25436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb26be7a-efc5-4bb6-b8d1-3d23419d7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Volume dfa9c4cd-7c41-4545-a9b2-b9eca0b17126: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126', 'volume_size': 1, 'source_volid': 'f27fb6fd-de9e-4614-961a-fd7803c1428d', 'source_volstatus': 'available'} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:49 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:49 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:49 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973" returned: 0 in 1.020s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.199s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:49 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Cloning volume f27fb6fd-de9e-4614-961a-fd7803c1428d to volume dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d946d642-a67e-45f3-ad71-eb42025d3f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc1b809-8780-431b-9462-da628546a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Volume volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 (6859f2ce-dbb0-4613-bf0d-cdd10de3c973): created successfully Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc1b809-8780-431b-9462-da628546a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Flow 'volume_create_manager' (8becf270-8478-419e-8129-fca6b4050c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Creating offline snapshot 5f4fb2fa-931f-40df-8b50-0c6903615a58 of volume f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fc9ee7f1-890c-4482-8113-31a812bc3d4c tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Created volume successfully. Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e06ab-fee0-48a9-b7a1-3bab31c0a22f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:49 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:33:49 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:49 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Deleted volume successfully. Jul 07 17:33:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5cebdcea-419c-4e79-9396-277c98359dc3 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-d74d2bb3-8474-4127-a735-c7d2684cd487-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "cinder-4091ff06-b198-4b13-9909-17905e055733-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-4091ff06-b198-4b13-9909-17905e055733-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "cinder-quobyte-4091ff06-b198-4b13-9909-17905e055733" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-4091ff06-b198-4b13-9909-17905e055733" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[71efc1c8-40b1-49af-9048-0c122a23e741]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:50 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:50 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:50 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:50 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:50 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 1.073s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:50 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 1G Jul 07 17:33:50 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.846s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-62828ab6-a32b-48e7-abe0-a098a1877d0a tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Retype volume completed successfully. Jul 07 17:33:51 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 1.153s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733 Jul 07 17:33:51 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 1G" returned: 0 in 1.107s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27fb6fd-de9e-4614-961a-fd7803c1428d -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27fb6fd-de9e-4614-961a-fd7803c1428d -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 Jul 07 17:33:51 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Acquiring lock "cinder-6859f2ce-dbb0-4613-bf0d-cdd10de3c973-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "cinder-6859f2ce-dbb0-4613-bf0d-cdd10de3c973-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Acquiring lock "cinder-quobyte-6859f2ce-dbb0-4613-bf0d-cdd10de3c973" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "cinder-quobyte-6859f2ce-dbb0-4613-bf0d-cdd10de3c973" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e405b0-40d7-447a-824f-cf0bb04544d4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 Jul 07 17:33:51 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:52 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4091ff06-b198-4b13-9909-17905e055733" returned: 0 in 0.881s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-quobyte-4091ff06-b198-4b13-9909-17905e055733" released by "delete_volume" :: held 2.121s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Created reservations ['bb037bfb-c174-45b9-ace5-1c2690b522a4', '0aae27dc-81b7-4225-b446-fbe8b6ec27d6', 'f44092ed-7441-4ff2-be26-2c85e4019946', '97d9a58f-1a0b-4976-a28e-07cfe16ee1b4'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:52 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:52 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:52 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27fb6fd-de9e-4614-961a-fd7803c1428d -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58" returned: 0 in 0.987s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:52 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 is being set with open permissions: ugo+rw Jul 07 17:33:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:52 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 Jul 07 17:33:52 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:53 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973" returned: 0 in 1.271s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:53 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973 Jul 07 17:33:53 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:53 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.882s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Deleted volume successfully. Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-edd0a011-cab2-4f9a-a5f9-da4fd23d1621 tempest-VolumesCloneTest-1434206888 None] Lock "cinder-4091ff06-b198-4b13-9909-17905e055733-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:53 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58" returned: 0 in 0.967s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:53 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info Jul 07 17:33:53 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:53 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6859f2ce-dbb0-4613-bf0d-cdd10de3c973" returned: 0 in 0.791s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "cinder-quobyte-6859f2ce-dbb0-4613-bf0d-cdd10de3c973" released by "delete_volume" :: held 2.125s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:54 devstack cinder-volume[87251]: WARNING cinder.quota [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:33:54 devstack cinder-volume[87251]: WARNING cinder.quota [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Created reservations ['6537815b-6a63-4e0b-b4f8-9d02e595d221', 'f9919955-427e-4605-ac7a-84d74d759e2c', '4a993f75-b487-4467-a788-f2b9ef53e0a1', '6e2f1e05-8265-45d3-bd20-ca5b4a38e8fc'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:54 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:33:54 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:54 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info" returned: 0 in 1.056s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:54 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info is being set with open permissions: ugo+rw Jul 07 17:33:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:54 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info Jul 07 17:33:54 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:55 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.991s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Deleted volume successfully. Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dcf20ec8-de78-4c96-881e-c89b28b84863 tempest-VolumeRetypeWithoutMigrationTest-1108602129 None] Lock "cinder-6859f2ce-dbb0-4613-bf0d-cdd10de3c973-delete_volume" released by "delete_volume" :: held 3.540s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:55 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.info" returned: 0 in 0.955s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] snapshot: 5f4fb2fa-931f-40df-8b50-0c6903615a58, volume: dfa9c4cd-7c41-4545-a9b2-b9eca0b17126, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a791a-5432-4734-8e68-1bf4aab84893]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:55 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 Jul 07 17:33:55 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:56 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58" returned: 0 in 1.091s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f27fb6fd-de9e-4614-961a-fd7803c1428d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:33:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:33:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[660ae5cb-33c9-49ed-95f2-98363a2fe395]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:56 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:33:56 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:57 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 1.064s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:57 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:33:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:57 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 Jul 07 17:33:57 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Flow 'volume_create_manager' (17fea200-9696-4ed3-9f41-84c26ae31c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d9c5bc-94e4-469b-9140-f056a1a3e3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d9c5bc-94e4-469b-9140-f056a1a3e3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-223371211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05602e42-88d9-4ebf-82fa-8f3251b79926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f4db3fb7a247cba763ba8d1fccadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:58Z,use_quota=True,user_id='c8a90805bea64164a83562a1f6f905ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0cf193-f1cf-4886-bc0d-65c0891af6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0cf193-f1cf-4886-bc0d-65c0891af6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44520f2a-89d3-485b-b07a-efd8c0b71b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44520f2a-89d3-485b-b07a-efd8c0b71b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05602e42-88d9-4ebf-82fa-8f3251b79926', 'volume_name': 'volume-05602e42-88d9-4ebf-82fa-8f3251b79926', 'volume_size': 2}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e006199d-dee4-41a0-906d-5703a4f8aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e006199d-dee4-41a0-906d-5703a4f8aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a685a52d-fba3-4ab2-97a9-58154f307131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Volume 05602e42-88d9-4ebf-82fa-8f3251b79926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05602e42-88d9-4ebf-82fa-8f3251b79926', 'volume_size': 2} Jul 07 17:33:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:04 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" returned: 0 in 6.236s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabc38e7-e8ef-4353-800b-0eb943ec804e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:04 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:34:04 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (b985b595-0087-4747-8108-9d2b196a2d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeee2652-0aef-4d48-b20c-7051683b9263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeee2652-0aef-4d48-b20c-7051683b9263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-344011962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:04Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cec62f-ae42-40ce-9f4b-5488bc052f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cec62f-ae42-40ce-9f4b-5488bc052f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cb4f70-b611-433a-a48f-f1c81950c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cb4f70-b611-433a-a48f-f1c81950c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd', 'volume_name': 'volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83693ba2-67bb-4939-8f96-c9142ac61247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83693ba2-67bb-4939-8f96-c9142ac61247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd359003-7c80-4156-b20b-61101a6345cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:04 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Volume fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd', 'volume_size': 1} Jul 07 17:34:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:05 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 1.124s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:05 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:34:05 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Converted 1024.00 MB image at 164.11 MB/s Jul 07 17:34:05 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 is being set with open permissions: ugo+rw Jul 07 17:34:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:05 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 Jul 07 17:34:05 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:06 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" returned: 0 in 0.731s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" released by "_copy_volume_from_snapshot" :: held 10.384s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-5f4fb2fa-931f-40df-8b50-0c6903615a58" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-5f4fb2fa-931f-40df-8b50-0c6903615a58" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Deleting offline snapshot 5f4fb2fa-931f-40df-8b50-0c6903615a58 of volume f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] snapshot_file for this snap is: volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b377c91-384e-46bf-aba1-37c65130db43]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:06 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 Jul 07 17:34:06 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:06 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58" returned: 0 in 0.835s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f27fb6fd-de9e-4614-961a-fd7803c1428d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f45fda-1c97-4dfe-ae80-a6a3dd12d359]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:07 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:34:07 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:07 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 0.872s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:07 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 Jul 07 17:34:07 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:08 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58" returned: 0 in 0.817s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:08 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58 Jul 07 17:34:08 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:09 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d.5f4fb2fa-931f-40df-8b50-0c6903615a58" returned: 0 in 0.794s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-5f4fb2fa-931f-40df-8b50-0c6903615a58" released by "_delete_snapshot" :: held 3.419s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.233s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.101s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-223371211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05602e42-88d9-4ebf-82fa-8f3251b79926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f4db3fb7a247cba763ba8d1fccadba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:58Z,use_quota=True,user_id='c8a90805bea64164a83562a1f6f905ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Creating volume 05602e42-88d9-4ebf-82fa-8f3251b79926 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 2147483648 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb26be7a-efc5-4bb6-b8d1-3d23419d7c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126', 'volume_size': 1, 'source_volid': 'f27fb6fd-de9e-4614-961a-fd7803c1428d', 'source_volstatus': 'available'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:09 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 2147483648 Jul 07 17:34:09 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c5271-c814-4fa7-ae08-eb6d176862a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Volume volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 (dfa9c4cd-7c41-4545-a9b2-b9eca0b17126): created successfully Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c5271-c814-4fa7-ae08-eb6d176862a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (cf08a11e-3baf-4900-8177-94ed84bc652c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-182165b7-28e0-429c-ad12-54fbbe4faa57 tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:34:10 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 2147483648" returned: 0 in 1.169s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:10 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 Jul 07 17:34:10 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (4265e81c-b984-461c-b3c5-cbed01b2b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0288ed8-9e97-4ef6-9438-c9862d673210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0288ed8-9e97-4ef6-9438-c9862d673210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1433441671',display_name='tempest-VolumesGetTest-Volume-377231158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c480f9-5ce0-46a6-9d24-b0f97c12638e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:11Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb9b21-2a39-4647-af9f-48b61a336e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb9b21-2a39-4647-af9f-48b61a336e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46f274b-f6a6-4282-8dc8-1cc9428acf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46f274b-f6a6-4282-8dc8-1cc9428acf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c480f9-5ce0-46a6-9d24-b0f97c12638e', 'volume_name': 'volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0244f737-4b5e-449c-a5cd-fb0eb3501ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0244f737-4b5e-449c-a5cd-fb0eb3501ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a0b44a-6b17-4629-af64-25c0810520a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Volume 50c480f9-5ce0-46a6-9d24-b0f97c12638e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e', 'volume_size': 1} Jul 07 17:34:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:11 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926" returned: 0 in 0.759s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.947s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-344011962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:04Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Creating volume fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:11 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a685a52d-fba3-4ab2-97a9-58154f307131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05602e42-88d9-4ebf-82fa-8f3251b79926', 'volume_size': 2}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:11 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd 1073741824 Jul 07 17:34:11 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337fe53d-016d-483e-9428-01bdb25d7994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Volume volume-05602e42-88d9-4ebf-82fa-8f3251b79926 (05602e42-88d9-4ebf-82fa-8f3251b79926): created successfully Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337fe53d-016d-483e-9428-01bdb25d7994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Flow 'volume_create_manager' (17fea200-9696-4ed3-9f41-84c26ae31c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d19e3bcf-609b-4a6c-9672-0d49b9b288c3 tempest-VolumesCloneNegativeTest-1018104823 None] Created volume successfully. Jul 07 17:34:12 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd 1073741824" returned: 0 in 0.953s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:12 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd Jul 07 17:34:12 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Acquiring lock "cinder-05602e42-88d9-4ebf-82fa-8f3251b79926-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "cinder-05602e42-88d9-4ebf-82fa-8f3251b79926-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Acquiring lock "cinder-quobyte-05602e42-88d9-4ebf-82fa-8f3251b79926" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "cinder-quobyte-05602e42-88d9-4ebf-82fa-8f3251b79926" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc5efa5-8531-40ab-89ba-6274d878727a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:13 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 Jul 07 17:34:13 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:13 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd" returned: 0 in 0.848s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.475s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1433441671',display_name='tempest-VolumesGetTest-Volume-377231158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c480f9-5ce0-46a6-9d24-b0f97c12638e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:11Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Creating volume 50c480f9-5ce0-46a6-9d24-b0f97c12638e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:13 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd359003-7c80-4156-b20b-61101a6345cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb5db25-14b9-432c-a1b2-84bd5519468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:13 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Volume volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd (fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd): created successfully Jul 07 17:34:13 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e 1073741824 Jul 07 17:34:13 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb5db25-14b9-432c-a1b2-84bd5519468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (b985b595-0087-4747-8108-9d2b196a2d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7386c4f9-1b21-43e6-821f-319c1dc79520 tempest-ProjectReaderTests-893252197 None] Created volume successfully. Jul 07 17:34:13 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926" returned: 0 in 1.023s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:13 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926 Jul 07 17:34:13 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Lock "cinder-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-quobyte-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:14 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e 1073741824" returned: 0 in 1.300s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab84ccc-e147-46a0-811d-5f43fe808584]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:14 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e Jul 07 17:34:14 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:14 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-05602e42-88d9-4ebf-82fa-8f3251b79926" returned: 0 in 0.943s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:14 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd Jul 07 17:34:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "cinder-quobyte-05602e42-88d9-4ebf-82fa-8f3251b79926" released by "delete_volume" :: held 2.036s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:14 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Created reservations ['df2030a8-7b44-4cb2-89a4-6204828c0784', 'c8ef068e-15a2-4bae-a63b-e16ed186f106', '63a4c444-3937-467b-bed9-55bb89fa00fb', '24db977e-a5d8-455f-91bc-99d993fd9dc6'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:15 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:15 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:15 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd" returned: 0 in 1.121s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:15 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:15 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e" returned: 0 in 1.133s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] <== create_volume: return (2498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:15 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.502s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a0b44a-6b17-4629-af64-25c0810520a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a0a5ae-8b7c-4e32-9504-5641dfba5863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:15 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Volume volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e (50c480f9-5ce0-46a6-9d24-b0f97c12638e): created successfully Jul 07 17:34:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a0a5ae-8b7c-4e32-9504-5641dfba5863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (4265e81c-b984-461c-b3c5-cbed01b2b5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-22557b2c-0a0c-4527-bd1a-678685c4727d tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:34:16 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.861s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Deleted volume successfully. Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15fe3b09-9243-4ba2-ab1d-e4a8d3207ed3 tempest-VolumesCloneNegativeTest-1018104823 None] Lock "cinder-05602e42-88d9-4ebf-82fa-8f3251b79926-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-50c480f9-5ce0-46a6-9d24-b0f97c12638e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Lock "cinder-50c480f9-5ce0-46a6-9d24-b0f97c12638e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-50c480f9-5ce0-46a6-9d24-b0f97c12638e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-50c480f9-5ce0-46a6-9d24-b0f97c12638e" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d771cb1-a9ec-453a-b831-ea66d8057aa1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:16 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e Jul 07 17:34:16 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:16 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd" returned: 0 in 1.007s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd" released by "delete_volume" :: held 2.193s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Created reservations ['67e1a556-c248-4947-9181-5eb7fec20609', '26216bd7-4c48-4255-ab27-198ea91735b2', '3411ffba-985b-452b-8958-17aabbcdcc76', '2348fb3c-6318-45c7-bc31-0eefecff3fda'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:17 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:17 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:17 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e" returned: 0 in 1.112s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:17 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e Jul 07 17:34:17 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.898s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Deleted volume successfully. Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e7fca987-286f-46a0-bba2-231ff1762cd7 tempest-ProjectReaderTests-893252197 None] Lock "cinder-fd84bec4-3bc5-4f07-b6db-b307b3b8c3cd-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (0b0e6932-f6fa-4a72-abe6-2352b01a5a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997b270f-7482-4028-a097-3c9b914c38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997b270f-7482-4028-a097-3c9b914c38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875420625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:19Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27033f5e-bbab-4964-bdcc-e1b26eac6af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27033f5e-bbab-4964-bdcc-e1b26eac6af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b839e6b-0a20-4c15-ac1f-e1ac5cb64aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b839e6b-0a20-4c15-ac1f-e1ac5cb64aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9', 'volume_name': 'volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca012b6f-e5ad-4df4-be54-90368fbfd1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca012b6f-e5ad-4df4-be54-90368fbfd1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c4abaf-c25c-4dbe-aba6-4209f669575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Volume 3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9', 'volume_size': 1} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875420625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:19Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Creating volume 3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:18 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:18 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 1073741824 Jul 07 17:34:18 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-50c480f9-5ce0-46a6-9d24-b0f97c12638e" returned: 0 in 1.067s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-50c480f9-5ce0-46a6-9d24-b0f97c12638e" released by "delete_volume" :: held 2.263s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:18 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Created reservations ['b509cb87-0b38-4917-a4cb-bfd031e1256c', '2a8ea60f-84a9-44ae-bc10-c654a993538c', '79195d25-7f42-4ed2-b8fb-6959a6a0bac0', 'dbcf292a-aa89-48b1-a31b-e38dcfa45d69'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:19 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:19 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:20 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:20 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.979s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 1073741824" returned: 0 in 1.241s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f125434-98d4-408a-b520-910eada9bc61 tempest-VolumesGetTest-1781536400 None] Lock "cinder-50c480f9-5ce0-46a6-9d24-b0f97c12638e-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:20 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 Jul 07 17:34:20 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Lock "cinder-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ed2029-fcf9-43b8-b40c-f8e792805303]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:20 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 Jul 07 17:34:20 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:21 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9" returned: 0 in 0.926s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c4abaf-c25c-4dbe-aba6-4209f669575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a8cc34-e633-450e-95d2-43d5ef014935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:21 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Volume volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 (3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9): created successfully Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a8cc34-e633-450e-95d2-43d5ef014935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (0b0e6932-f6fa-4a72-abe6-2352b01a5a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ee4796ad-222e-4ae5-b816-e22e480d1cde tempest-ProjectReaderTests-893252197 None] Created volume successfully. Jul 07 17:34:21 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" returned: 0 in 1.098s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:21 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126 Jul 07 17:34:21 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Flow 'volume_create_manager' (f7551e46-3a5d-44f5-88e0-59d444c54d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac089c5f-03a4-4161-a558-7c0b3f4c42d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac089c5f-03a4-4161-a558-7c0b3f4c42d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-893800093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf208161-ec13-460a-b57c-ad3caaf91415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fe87218f50497dbe86d4187d7e1661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:22Z,use_quota=True,user_id='f47cb5269846493ea5ba54ca9a30e831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77be5ef-3c50-46e7-be11-bb08d7055d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77be5ef-3c50-46e7-be11-bb08d7055d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c6b54e-be54-4030-94c4-40a0ed653e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:21 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c6b54e-be54-4030-94c4-40a0ed653e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf208161-ec13-460a-b57c-ad3caaf91415', 'volume_name': 'volume-bf208161-ec13-460a-b57c-ad3caaf91415', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac3eb90-86e8-437c-b2e7-f23d96b80fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac3eb90-86e8-437c-b2e7-f23d96b80fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7221cd41-fcd4-497e-9293-6149f1eb6d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:22 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Volume bf208161-ec13-460a-b57c-ad3caaf91415: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf208161-ec13-460a-b57c-ad3caaf91415', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Trying to clone bf208161-ec13-460a-b57c-ad3caaf91415 from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Lock "cinder-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-quobyte-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[943cbccf-9601-4844-9f51-5b0116f2505a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:22 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" returned: 0 in 0.966s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:22 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126" released by "delete_volume" :: held 2.191s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:22 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:34:22 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Created reservations ['3ca1414b-9e52-465a-a427-51330dfec902', '0665501f-b633-4f6a-8fd9-f5981ab16d36', '2d3bf54f-f84c-4e2b-b764-a3953addc55d', '276700af-bc52-43ca-a4b3-23efa1c5fbfd'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[497a66b1-c7b0-4949-9b6f-deee2cede8e0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:22 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:22 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:22 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD Jul 07 17:34:22 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:23 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD" returned: 0 in 0.970s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 is fetched for user f47cb5269846493ea5ba54ca9a30e831. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:34:23 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9" returned: 0 in 1.386s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:23 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9 Jul 07 17:34:23 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:23 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.944s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0c3de-d723-4e53-9f9a-8fa0fa3cf894]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1d9a474-d07c-450d-bb0b-05965a35b231 tempest-VolumesGetTest-1781536400 None] Lock "cinder-dfa9c4cd-7c41-4545-a9b2-b9eca0b17126-delete_volume" released by "delete_volume" :: held 3.574s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-f27fb6fd-de9e-4614-961a-fd7803c1428d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Lock "cinder-f27fb6fd-de9e-4614-961a-fd7803c1428d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:23 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD Jul 07 17:34:23 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-f27fb6fd-de9e-4614-961a-fd7803c1428d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-f27fb6fd-de9e-4614-961a-fd7803c1428d" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca54208-f26b-4a13-93eb-38314c8806fe]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:24 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:34:24 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:24 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9" returned: 0 in 0.858s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9" released by "delete_volume" :: held 2.305s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Created reservations ['203e2a9d-8e79-4364-885e-e429486b5c51', '5802f36a-9e45-4bfc-b1a6-9087cf74c618', 'b740925f-618b-4aaa-8cb6-4855a120ed05', '26a2298e-6fb3-42ec-b0f6-51af4b3f5e09'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:24 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-893800093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf208161-ec13-460a-b57c-ad3caaf91415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fe87218f50497dbe86d4187d7e1661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:22Z,use_quota=True,user_id='f47cb5269846493ea5ba54ca9a30e831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Creating volume bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:24 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:24 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 1073741824 Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:24 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:24 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:24 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:25 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 1.015s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:25 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d Jul 07 17:34:25 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:25 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.999s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:25 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:25 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Deleted volume successfully. Jul 07 17:34:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-74ce917d-fd61-44ca-9d10-9949ea258bcd tempest-ProjectReaderTests-893252197 None] Lock "cinder-3b5f4baa-34cb-49ad-9ca6-1e9ed7a140b9-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:26 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f27fb6fd-de9e-4614-961a-fd7803c1428d" returned: 0 in 0.999s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-f27fb6fd-de9e-4614-961a-fd7803c1428d" released by "delete_volume" :: held 2.102s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:26 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 1073741824" returned: 0 in 1.327s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:26 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:26 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Created reservations ['10dc7152-1c61-42ec-92da-460c1e298c27', 'fed77aef-1c11-4b95-b8e0-c565fcb216d2', '451c5aac-3dd8-4653-8888-1849dad1fa52', 'be955630-60e1-438c-97da-f48bf53f0e40'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (40cc7df1-65ff-4719-9bdc-ede706aa83c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8fc907-5e15-42c5-ac03-672ecabff5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8fc907-5e15-42c5-ac03-672ecabff5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823587607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7ce1e6-a283-4fab-91e4-1782b2267c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:26Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6881b2-f176-4df6-aee8-f55745098c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:26 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:26 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6881b2-f176-4df6-aee8-f55745098c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03189d73-7db5-48d3-8dd8-91e1e3757380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03189d73-7db5-48d3-8dd8-91e1e3757380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7ce1e6-a283-4fab-91e4-1782b2267c9f', 'volume_name': 'volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4056f0-9b09-43f9-b7c5-a0bd79bc72dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4056f0-9b09-43f9-b7c5-a0bd79bc72dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9cb950-31fb-492f-87fb-1479177a0712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Volume db7ce1e6-a283-4fab-91e4-1782b2267c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f', 'volume_size': 1} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:26 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823587607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7ce1e6-a283-4fab-91e4-1782b2267c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:26Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Creating volume db7ce1e6-a283-4fab-91e4-1782b2267c9f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:27 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:27 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f 1073741824 Jul 07 17:34:27 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Attempting download of 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume bf208161-ec13-460a-b57c-ad3caaf91415. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36cc3dc-ce09-4554-9118-c5ab6dc0511f]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:27 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw Jul 07 17:34:27 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:27 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.811s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:34:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5dc7d5cd-f940-489f-91df-a49ffd3823ce tempest-VolumesGetTest-1781536400 None] Lock "cinder-f27fb6fd-de9e-4614-961a-fd7803c1428d-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:28 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw" returned: 0 in 1.034s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:28 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f 1073741824" returned: 0 in 1.304s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:28 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw Jul 07 17:34:28 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:28 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f Jul 07 17:34:28 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (99140412-5945-4ff8-b4d4-aefed3170270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce7db6-e508-4c9f-bece-3b7c01e1eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce7db6-e508-4c9f-bece-3b7c01e1eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-809031711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db583973-1d07-4deb-a32d-8932abe1cd07,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:28Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75658a49-ddec-45e4-bc4f-0da3682d9335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75658a49-ddec-45e4-bc4f-0da3682d9335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e7ff03-0881-4cca-a933-beff0355a5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e7ff03-0881-4cca-a933-beff0355a5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db583973-1d07-4deb-a32d-8932abe1cd07', 'volume_name': 'volume-db583973-1d07-4deb-a32d-8932abe1cd07', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e628c33e-fdd1-497a-a9dc-d9403c36d4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e628c33e-fdd1-497a-a9dc-d9403c36d4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b23721-0518-4087-9671-bb25dc83b6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Volume db583973-1d07-4deb-a32d-8932abe1cd07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db583973-1d07-4deb-a32d-8932abe1cd07', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Trying to clone db583973-1d07-4deb-a32d-8932abe1cd07 from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:34:29 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:29 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw" returned: 1 in 1.173s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_q9_jflkw' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f" returned: 0 in 0.934s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc32d57-c785-4c09-bfce-581781f2e632]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9cb950-31fb-492f-87fb-1479177a0712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c8b79-0261-4878-b9ca-ff503f497ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Volume volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f (db7ce1e6-a283-4fab-91e4-1782b2267c9f): created successfully Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c8b79-0261-4878-b9ca-ff503f497ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (40cc7df1-65ff-4719-9bdc-ede706aa83c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7fb5675f-c5ef-4d43-bdfe-ad8763389b1d tempest-ProjectReaderTests-893252197 None] Created volume successfully. Jul 07 17:34:29 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD Jul 07 17:34:29 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:34:29 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dab7cf-71ee-4266-bb43-bcbe59a3b676]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-db7ce1e6-a283-4fab-91e4-1782b2267c9f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:29 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD Jul 07 17:34:29 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Lock "cinder-db7ce1e6-a283-4fab-91e4-1782b2267c9f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-quobyte-db7ce1e6-a283-4fab-91e4-1782b2267c9f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-db7ce1e6-a283-4fab-91e4-1782b2267c9f" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[932e585c-f4dc-476f-b384-05d4a5991fd0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:30 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f Jul 07 17:34:30 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:30 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD" returned: 0 in 1.216s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 was qcow2, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:30 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:30 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:30 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD" returned: 0 in 1.069s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 is fetched for user 2cbaa7ce44f7426eb1652526737ed765. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:34:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e19713e-62dd-4651-9e66-54efc34dd8ac]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:31 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD Jul 07 17:34:31 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:31 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f" returned: 0 in 1.106s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:31 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f Jul 07 17:34:31 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:31 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD" returned: 0 in 0.904s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-809031711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db583973-1d07-4deb-a32d-8932abe1cd07,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:28Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Creating volume db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:31 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:31 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 1073741824 Jul 07 17:34:31 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:32 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db7ce1e6-a283-4fab-91e4-1782b2267c9f" returned: 0 in 0.956s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-db7ce1e6-a283-4fab-91e4-1782b2267c9f" released by "delete_volume" :: held 2.125s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Created reservations ['65b7ea9a-e684-47fa-ace2-8963d2f9190e', '41585ed0-2fc1-4149-a680-f9aa6a463c24', 'a5f2619e-8073-409a-b365-126538b00e25', '4909118e-4ee4-4b54-bb23-6faef902a62d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:32 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:32 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:32 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:32 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:33 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 0 in 2.572s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_u4ql3s7ydevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:34:33 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Converted 112.00 MB image at 43.52 MB/s Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:33 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 1G Jul 07 17:34:33 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:33 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.874s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Deleted volume successfully. Jul 07 17:34:33 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 1073741824" returned: 0 in 1.404s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-aff7c496-0fd0-4ab1-b22f-438c6759844e tempest-ProjectReaderTests-893252197 None] Lock "cinder-db7ce1e6-a283-4fab-91e4-1782b2267c9f-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:33 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:33 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:34 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.287s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:34:34 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 1G" returned: 0 in 1.069s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (ba91f895-0b8e-405a-a6e1-80491b30fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:34 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f17a3-bba5-4a9a-a442-0e945b6b76f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b9964-93eb-4f9a-ba9f-fb4fd7bd2eba]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 0 in 0.928s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f17a3-bba5-4a9a-a442-0e945b6b76f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496880838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524f1220-2304-450c-b69b-ea7d9851e0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:34Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c43f126-f82d-42ae-aa93-0ca145155194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c43f126-f82d-42ae-aa93-0ca145155194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecea066-3eb5-4351-86cf-735565d96353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecea066-3eb5-4351-86cf-735565d96353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524f1220-2304-450c-b69b-ea7d9851e0eb', 'volume_name': 'volume-524f1220-2304-450c-b69b-ea7d9851e0eb', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe39259-c24c-4964-b879-61d348efe901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe39259-c24c-4964-b879-61d348efe901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09583093-0a6d-4ac0-975f-8b7d4e22db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:34 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Volume 524f1220-2304-450c-b69b-ea7d9851e0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524f1220-2304-450c-b69b-ea7d9851e0eb', 'volume_size': 1} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496880838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524f1220-2304-450c-b69b-ea7d9851e0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8c65fd389e422ea2cce17f83391963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:34Z,use_quota=True,user_id='8545e5f251f04f53a1613c208d835e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Creating volume 524f1220-2304-450c-b69b-ea7d9851e0eb {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:34 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:34 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb 1073741824 Jul 07 17:34:34 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Attempting download of 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume db583973-1d07-4deb-a32d-8932abe1cd07. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:34:34 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:34 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2ebb21-e323-4b8d-a406-514c737d15a8]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:34 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf Jul 07 17:34:34 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:35 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 0 in 0.863s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:35 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:35 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:35 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf" returned: 0 in 0.882s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:35 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb 1073741824" returned: 0 in 1.041s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:35 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb Jul 07 17:34:35 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:35 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf Jul 07 17:34:35 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:36 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 1 in 1.239s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Downloaded image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume bf208161-ec13-460a-b57c-ad3caaf91415 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 for user f47cb5269846493ea5ba54ca9a30e831 is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Marking volume bf208161-ec13-460a-b57c-ad3caaf91415 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Copying metadata from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 to bf208161-ec13-460a-b57c-ad3caaf91415. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Creating volume glance metadata for volume bf208161-ec13-460a-b57c-ad3caaf91415 backed by image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7221cd41-fcd4-497e-9293-6149f1eb6d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf208161-ec13-460a-b57c-ad3caaf91415', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f5cce2-348c-4276-9b1c-c4ff908dced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:36 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Volume volume-bf208161-ec13-460a-b57c-ad3caaf91415 (bf208161-ec13-460a-b57c-ad3caaf91415): created successfully Jul 07 17:34:36 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f5cce2-348c-4276-9b1c-c4ff908dced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Flow 'volume_create_manager' (f7551e46-3a5d-44f5-88e0-59d444c54d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf" returned: 1 in 1.263s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_97oow_bf' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960bfe7-327e-4719-8222-7b9ee32d070f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:36 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cab663e0-6704-42c6-afea-ba0dbcf3d59b tempest-VolumesExtendTest-695200568 None] Created volume successfully. Jul 07 17:34:36 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb" returned: 0 in 1.200s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09583093-0a6d-4ac0-975f-8b7d4e22db7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524f1220-2304-450c-b69b-ea7d9851e0eb', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698fabdf-0d1e-4962-8e09-fc5a6f67419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:36 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Volume volume-524f1220-2304-450c-b69b-ea7d9851e0eb (524f1220-2304-450c-b69b-ea7d9851e0eb): created successfully Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698fabdf-0d1e-4962-8e09-fc5a6f67419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Flow 'volume_create_manager' (ba91f895-0b8e-405a-a6e1-80491b30fae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:36 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e9f1d13c-1872-4599-ba21-2200c323a440 tempest-ProjectReaderTests-893252197 None] Created volume successfully. Jul 07 17:34:36 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD Jul 07 17:34:36 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f818e2d5-dfe1-4466-a0fa-0491643bc35d]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-524f1220-2304-450c-b69b-ea7d9851e0eb-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Lock "cinder-524f1220-2304-450c-b69b-ea7d9851e0eb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:37 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:37 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:37 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD" returned: 0 in 0.956s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 was qcow2, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:37 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:37 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Acquiring lock "cinder-quobyte-524f1220-2304-450c-b69b-ea7d9851e0eb" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-524f1220-2304-450c-b69b-ea7d9851e0eb" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883b786-06dc-44aa-91fa-5cc68c0f82c5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:37 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb Jul 07 17:34:37 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:38 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 0 in 1.151s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:38 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:38 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:38 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb" returned: 0 in 1.101s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:38 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb Jul 07 17:34:38 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:39 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 1 in 1.088s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 2G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 2G" returned: 0 in 0.097s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.409s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:39 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-524f1220-2304-450c-b69b-ea7d9851e0eb" returned: 0 in 0.979s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Lock "cinder-quobyte-524f1220-2304-450c-b69b-ea7d9851e0eb" released by "delete_volume" :: held 2.135s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5b2aef26-38e3-4ccf-8c0a-32391c099ba9 tempest-VolumesExtendTest-695200568 None] Extend volume completed successfully. Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Created reservations ['d3d4c623-25d9-4cba-b09d-53ef76cd0e86', '05f15fec-5089-4a8d-8420-7812cc35c01f', '07002d24-e4de-4089-a330-c5f6cb806f8a', 'de5c28f7-cde7-4d08-a9ad-1b6065edfabf'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:40 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:40 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:40 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 0 in 2.669s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_ehz7k9b0devstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:34:40 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Converted 112.00 MB image at 41.94 MB/s Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:40 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 1G Jul 07 17:34:40 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:40 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.837s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:40 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Deleted volume successfully. Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=91,cinder:UPDATE=143,cinder:DELETE=16,cinder:INSERT=36 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-48665ff0-e023-4aff-92a2-7feed3ab29f5 tempest-ProjectReaderTests-893252197 None] Lock "cinder-524f1220-2304-450c-b69b-ea7d9851e0eb-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-bf208161-ec13-460a-b57c-ad3caaf91415-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Lock "cinder-bf208161-ec13-460a-b57c-ad3caaf91415-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=125,cinder:SELECT=105,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-quobyte-bf208161-ec13-460a-b57c-ad3caaf91415" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-bf208161-ec13-460a-b57c-ad3caaf91415" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30ae4d-7ff6-4e3a-94b8-b8f6261ab8c7]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:41 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 1G" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f29c564-12cb-4fb4-99fc-0b082919dc0c]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:41 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:41 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:41 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:41 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:42 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 0 in 1.057s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:42 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 0 in 1.039s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:42 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:42 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:42 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:42 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:43 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 1 in 1.055s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Downloaded image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume db583973-1d07-4deb-a32d-8932abe1cd07 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 for user 2cbaa7ce44f7426eb1652526737ed765 is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Marking volume db583973-1d07-4deb-a32d-8932abe1cd07 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Copying metadata from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 to db583973-1d07-4deb-a32d-8932abe1cd07. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Creating volume glance metadata for volume db583973-1d07-4deb-a32d-8932abe1cd07 backed by image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b23721-0518-4087-9671-bb25dc83b6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db583973-1d07-4deb-a32d-8932abe1cd07', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638cacc9-58ad-4d70-b2e1-7bbbdd2c493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:43 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 1 in 1.267s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:43 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Volume volume-db583973-1d07-4deb-a32d-8932abe1cd07 (db583973-1d07-4deb-a32d-8932abe1cd07): created successfully Jul 07 17:34:43 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415 Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638cacc9-58ad-4d70-b2e1-7bbbdd2c493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:43 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (99140412-5945-4ff8-b4d4-aefed3170270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-796b33f8-6329-40e4-8000-68537e97ec6b tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:34:44 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Flow 'volume_create_manager' (d8e91cb4-636d-4f75-97f6-07d644c93ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf5f728-1f12-4624-9e32-7fd68b62c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bf208161-ec13-460a-b57c-ad3caaf91415" returned: 0 in 0.877s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf5f728-1f12-4624-9e32-7fd68b62c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1324673586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f27d9ba8ae4f209adfd0d78f3fb734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:44Z,use_quota=True,user_id='8e3ebb006ee84fbe966d5aaa84454fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4772fd99-950b-4a17-afde-6bb5c4dcee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4772fd99-950b-4a17-afde-6bb5c4dcee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690d6d91-3342-47bc-bebe-f5bc70cf963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690d6d91-3342-47bc-bebe-f5bc70cf963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7', 'volume_name': 'volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16199070-9ace-43c0-a99a-5f04549b1792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16199070-9ace-43c0-a99a-5f04549b1792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141cfee1-c6fb-4285-a140-48b0c1e02aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Volume 2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7', 'volume_size': 1} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1324673586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f27d9ba8ae4f209adfd0d78f3fb734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:44Z,use_quota=True,user_id='8e3ebb006ee84fbe966d5aaa84454fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Creating volume 2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:44 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-bf208161-ec13-460a-b57c-ad3caaf91415" released by "delete_volume" :: held 3.371s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:44 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 1073741824 Jul 07 17:34:44 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Created reservations ['182c9ae8-391a-4745-a898-ed726d79a9da', 'b6ef058b-dda1-4703-abaa-ad7b312e89b3', '48eafc30-972c-48c5-8cc1-5352b5689caa', '62c0dbb5-e7ca-4189-ae2c-d74fcdc6cce0'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:44 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:44 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:44 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (8eda97af-a15f-48aa-8159-65f9d4450c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134c04a9-3183-49ae-9d70-9398c3cb6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134c04a9-3183-49ae-9d70-9398c3cb6e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-901603608',display_name='tempest-VolumesGetTest-Volume-73771874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1f7f1b-2942-4b69-bba7-93ae1d26758d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:45Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95b8033-d37c-41c0-a209-4e5d40c64a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95b8033-d37c-41c0-a209-4e5d40c64a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b165402c-1a59-414b-be61-2ccbf795e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b165402c-1a59-414b-be61-2ccbf795e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1f7f1b-2942-4b69-bba7-93ae1d26758d', 'volume_name': 'volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4b28e8-4009-45e6-bd84-b1ef5ebf2517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4b28e8-4009-45e6-bd84-b1ef5ebf2517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17a2fed-81ce-442a-9158-1c5d2d6bdb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Volume 7f1f7f1b-2942-4b69-bba7-93ae1d26758d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d', 'volume_size': 1} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Flow 'volume_create_manager' (d0c3ad54-4903-4937-9e2d-1bac0530741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e9bb16-6892-4dcd-aaab-6d48455c80a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e9bb16-6892-4dcd-aaab-6d48455c80a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1849534681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d7d1a3-3e8e-404f-9027-8ab2e88d6a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f27d9ba8ae4f209adfd0d78f3fb734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:45Z,use_quota=True,user_id='8e3ebb006ee84fbe966d5aaa84454fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66eb8044-b25f-46e0-844f-269565de0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66eb8044-b25f-46e0-844f-269565de0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949cbb0f-be54-4765-b467-bfd280482b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949cbb0f-be54-4765-b467-bfd280482b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d7d1a3-3e8e-404f-9027-8ab2e88d6a94', 'volume_name': 'volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d52c4f4-445f-467a-9195-bdea5774ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d52c4f4-445f-467a-9195-bdea5774ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd61a8f7-8e65-4bce-bff3-cc7e3c8e96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Volume 45d7d1a3-3e8e-404f-9027-8ab2e88d6a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94', 'volume_size': 1} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:45 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.797s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:45 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Deleted volume successfully. Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-32541bc3-dc00-406e-bb53-44d8363ab39a tempest-VolumesExtendTest-695200568 None] Lock "cinder-bf208161-ec13-460a-b57c-ad3caaf91415-delete_volume" released by "delete_volume" :: held 4.522s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:45 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 1073741824" returned: 0 in 1.117s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:45 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 Jul 07 17:34:45 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:46 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Flow 'volume_create_manager' (6490a9db-9c8b-4b6b-a3ad-4f3448a16286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72faa529-4245-4f9b-9147-accffa2de292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" returned: 0 in 0.794s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-901603608',display_name='tempest-VolumesGetTest-Volume-73771874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1f7f1b-2942-4b69-bba7-93ae1d26758d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98aa3be51e1f449c836a65ab9d6ac316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:45Z,use_quota=True,user_id='2cbaa7ce44f7426eb1652526737ed765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Creating volume 7f1f7f1b-2942-4b69-bba7-93ae1d26758d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:46 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72faa529-4245-4f9b-9147-accffa2de292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1552346769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a528e1a-d483-4f3c-a7b3-546affe783af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fe87218f50497dbe86d4187d7e1661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:46Z,use_quota=True,user_id='f47cb5269846493ea5ba54ca9a30e831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d 1073741824 Jul 07 17:34:46 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ca0819-d15e-42a8-9d1f-b132c77cabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ca0819-d15e-42a8-9d1f-b132c77cabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ee97e5-4458-4527-ab60-5267ce9515d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ee97e5-4458-4527-ab60-5267ce9515d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a528e1a-d483-4f3c-a7b3-546affe783af', 'volume_name': 'volume-5a528e1a-d483-4f3c-a7b3-546affe783af', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4093e0-3821-4b22-9bae-70305d54756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4093e0-3821-4b22-9bae-70305d54756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2772a4a0-99d5-44b9-9349-6f6206a07009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Volume 5a528e1a-d483-4f3c-a7b3-546affe783af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a528e1a-d483-4f3c-a7b3-546affe783af', 'volume_size': 1} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141cfee1-c6fb-4285-a140-48b0c1e02aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e5e91d-502b-47b7-b269-7a9ab61a48fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Volume volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 (2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7): created successfully Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e5e91d-502b-47b7-b269-7a9ab61a48fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Flow 'volume_create_manager' (d8e91cb4-636d-4f75-97f6-07d644c93ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3489e68d-51af-405b-b0de-ed36a2e0b5e9 tempest-TestServerVolumeAttachmentScenario-274426055 None] Created volume successfully. Jul 07 17:34:47 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d 1073741824" returned: 0 in 0.924s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:47 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d Jul 07 17:34:47 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:48 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d" returned: 0 in 0.699s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.757s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1849534681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d7d1a3-3e8e-404f-9027-8ab2e88d6a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f27d9ba8ae4f209adfd0d78f3fb734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:45Z,use_quota=True,user_id='8e3ebb006ee84fbe966d5aaa84454fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Creating volume 45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:48 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:48 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 1073741824 Jul 07 17:34:48 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17a2fed-81ce-442a-9158-1c5d2d6bdb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234beda9-3cf2-4226-b32e-baab5b98ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:48 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Volume volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d (7f1f7f1b-2942-4b69-bba7-93ae1d26758d): created successfully Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234beda9-3cf2-4226-b32e-baab5b98ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Flow 'volume_create_manager' (8eda97af-a15f-48aa-8159-65f9d4450c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0efd49c7-ce60-4d88-9409-557a9508d14c tempest-VolumesGetTest-1781536400 None] Created volume successfully. Jul 07 17:34:49 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 1073741824" returned: 0 in 0.992s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:49 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 Jul 07 17:34:49 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-7f1f7f1b-2942-4b69-bba7-93ae1d26758d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Lock "cinder-7f1f7f1b-2942-4b69-bba7-93ae1d26758d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-7f1f7f1b-2942-4b69-bba7-93ae1d26758d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-7f1f7f1b-2942-4b69-bba7-93ae1d26758d" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b1895d-76bb-4778-9c38-405fb3db53d4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:49 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d Jul 07 17:34:49 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:49 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" returned: 0 in 0.717s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1552346769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a528e1a-d483-4f3c-a7b3-546affe783af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fe87218f50497dbe86d4187d7e1661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:46Z,use_quota=True,user_id='f47cb5269846493ea5ba54ca9a30e831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Creating volume 5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:49 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:49 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af 1073741824 Jul 07 17:34:49 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd61a8f7-8e65-4bce-bff3-cc7e3c8e96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a7a44f-305b-45d4-a122-3ec7ff941cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Volume volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 (45d7d1a3-3e8e-404f-9027-8ab2e88d6a94): created successfully Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a7a44f-305b-45d4-a122-3ec7ff941cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Flow 'volume_create_manager' (d0c3ad54-4903-4937-9e2d-1bac0530741c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-602d0bef-eb9e-40f3-8f12-2deded7adadc tempest-TestServerVolumeAttachmentScenario-274426055 None] Created volume successfully. Jul 07 17:34:50 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d" returned: 0 in 0.809s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:50 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d Jul 07 17:34:50 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:50 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af 1073741824" returned: 0 in 0.894s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:50 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7f1f7f1b-2942-4b69-bba7-93ae1d26758d" returned: 0 in 0.687s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:50 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af Jul 07 17:34:50 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-7f1f7f1b-2942-4b69-bba7-93ae1d26758d" released by "delete_volume" :: held 1.546s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Created reservations ['589cf359-cb5b-4cc5-b854-fa78d350cfaa', 'fb0268be-2b0f-4d76-ab4b-510e90fbc751', 'b0e5cab8-5530-400e-a028-51a7e6101189', '72ef0ff2-879e-493e-b401-f044efb56529'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:51 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:51 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:51 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af" returned: 0 in 0.688s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2772a4a0-99d5-44b9-9349-6f6206a07009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a528e1a-d483-4f3c-a7b3-546affe783af', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc17433b-eddf-46ce-b8ea-bf5f9f7be132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:51 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Volume volume-5a528e1a-d483-4f3c-a7b3-546affe783af (5a528e1a-d483-4f3c-a7b3-546affe783af): created successfully Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc17433b-eddf-46ce-b8ea-bf5f9f7be132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Flow 'volume_create_manager' (6490a9db-9c8b-4b6b-a3ad-4f3448a16286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-db583973-1d07-4deb-a32d-8932abe1cd07-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Lock "cinder-db583973-1d07-4deb-a32d-8932abe1cd07-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0c78f126-70e8-4572-89d3-d3358b376ff2 tempest-VolumesExtendTest-695200568 None] Created volume successfully. Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Acquiring lock "cinder-quobyte-db583973-1d07-4deb-a32d-8932abe1cd07" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-db583973-1d07-4deb-a32d-8932abe1cd07" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6c51a4-131d-4d1c-8b37-ae7f9d202941]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:51 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.752s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:34:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5053421-8926-4763-8c26-91513356c598 tempest-VolumesGetTest-1781536400 None] Lock "cinder-7f1f7f1b-2942-4b69-bba7-93ae1d26758d-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:51 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:51 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:52 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 0 in 0.795s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:52 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:52 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Creating offline snapshot a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 of volume 5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99dd7a2-7615-4f71-a2e8-1c2a9b0348d2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:53 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af Jul 07 17:34:53 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:53 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 1 in 1.176s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:53 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07 Jul 07 17:34:53 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:54 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af" returned: 0 in 1.114s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:54 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 1G Jul 07 17:34:54 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:54 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-db583973-1d07-4deb-a32d-8932abe1cd07" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Lock "cinder-quobyte-db583973-1d07-4deb-a32d-8932abe1cd07" released by "delete_volume" :: held 2.851s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Created reservations ['73435d55-c81e-4a0a-aa9a-7197a2b0046a', 'ed616181-a7e8-4069-904e-24b96ce7f091', 'd9bc5a2e-a9b6-4f28-8758-a96434a80969', '6fcae391-5119-4926-a12a-f97230101378'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:54 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:34:54 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:55 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 1G" returned: 0 in 1.203s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a528e1a-d483-4f3c-a7b3-546affe783af -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:55 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a528e1a-d483-4f3c-a7b3-546affe783af -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 Jul 07 17:34:55 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:55 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.912s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:55 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Deleted volume successfully. Jul 07 17:34:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d89bfb26-2279-461c-bdb9-c5c17a3ce350 tempest-VolumesGetTest-1781536400 None] Lock "cinder-db583973-1d07-4deb-a32d-8932abe1cd07-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:56 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a528e1a-d483-4f3c-a7b3-546affe783af -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" returned: 0 in 0.787s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:56 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 is being set with open permissions: ugo+rw Jul 07 17:34:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:56 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 Jul 07 17:34:56 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:56 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" returned: 0 in 0.690s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:56 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info Jul 07 17:34:56 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:57 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info" returned: 0 in 0.708s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:57 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info is being set with open permissions: ugo+rw Jul 07 17:34:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:57 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info Jul 07 17:34:57 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:58 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.info" returned: 0 in 0.717s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.322s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c45c46a9-db25-4e01-8dcc-9995dc7ce7c6 tempest-VolumesExtendTest-695200568 None] Create snapshot completed successfully Jul 07 17:34:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:59 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24c0924-8987-4ebd-a8f8-385056e5d59d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:59 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af Jul 07 17:34:59 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:00 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af" returned: 0 in 0.936s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 2G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 2G" returned: 0 in 0.197s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.178s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9c5dab3d-89f9-49cd-88ef-d0b8f865bf96 tempest-VolumesExtendTest-695200568 None] Extend volume completed successfully. Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Flow 'volume_create_manager' (4a09c046-e528-4051-a80b-228c8cc034d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a672aaf3-d545-4a7f-9141-c01f6ac6a846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a672aaf3-d545-4a7f-9141-c01f6ac6a846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2042914833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d752ca610b4f5fadaeeb01266b70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:02Z,use_quota=True,user_id='ac5611da768d46b9a5a2d8803109883b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f25b0c-2e02-45f6-907d-e2fec09bffe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f25b0c-2e02-45f6-907d-e2fec09bffe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdf285b-1d13-4d88-8d05-54b078b19b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdf285b-1d13-4d88-8d05-54b078b19b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9', 'volume_name': 'volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeccf44c-dfcd-413f-8cf9-857650ea8e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeccf44c-dfcd-413f-8cf9-857650ea8e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d29760-db0c-47f9-846f-74c76f3ddd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9', 'volume_size': 1} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2042914833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d752ca610b4f5fadaeeb01266b70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:02Z,use_quota=True,user_id='ac5611da768d46b9a5a2d8803109883b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Creating volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:01 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:01 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 1073741824 Jul 07 17:35:01 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Lock "cinder-a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-quobyte-5a528e1a-d483-4f3c-a7b3-546affe783af" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-5a528e1a-d483-4f3c-a7b3-546affe783af" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-quobyte-a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Deleting offline snapshot a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 of volume 5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] snapshot_file for this snap is: volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[826cbb02-290a-4f1b-b9de-7e79b2bba105]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:02 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 Jul 07 17:35:02 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:03 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 1073741824" returned: 0 in 1.251s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:03 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 Jul 07 17:35:03 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:03 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" returned: 0 in 1.054s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a528e1a-d483-4f3c-a7b3-546affe783af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4787e0-2c0d-48fe-89b3-48e3b19e23ae]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:03 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af Jul 07 17:35:03 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:03 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" returned: 0 in 0.853s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d29760-db0c-47f9-846f-74c76f3ddd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee4368e-8ac3-4044-a647-d11254cb273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:04 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Volume volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 (0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9): created successfully Jul 07 17:35:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee4368e-8ac3-4044-a647-d11254cb273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Flow 'volume_create_manager' (4a09c046-e528-4051-a80b-228c8cc034d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-71a4b9d0-ed81-4cf1-bb4a-063451658b60 tempest-VolumesSnapshotListTestJSON-605435374 None] Created volume successfully. Jul 07 17:35:04 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af" returned: 0 in 1.123s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:04 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 Jul 07 17:35:04 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Creating offline snapshot 46d9b471-77b9-44f8-a53e-670d2f01693a of volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bb6a0-4e47-4477-9956-e05c90d5c18f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:05 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 Jul 07 17:35:05 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:05 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" returned: 0 in 1.148s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:05 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848 Jul 07 17:35:05 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:06 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" returned: 0 in 0.865s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:06 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af.a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" returned: 0 in 0.703s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:06 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a 1G Jul 07 17:35:06 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848" released by "_delete_snapshot" :: held 4.198s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-5a528e1a-d483-4f3c-a7b3-546affe783af" released by "delete_snapshot" :: held 4.254s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Created reservations ['978a0449-716c-4cc1-8fac-2cbd772588a2', 'a8948867-149b-4e16-bbe8-cb6817dd5922', 'afc3f700-6296-4528-8f5e-5fccda942cea', 'e7e3acd7-ff19-447e-86d0-6e35342d19e0'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Delete snapshot completed successfully. Jul 07 17:35:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8afec759-c211-4c13-91bf-16e77d533059 tempest-VolumesExtendTest-695200568 None] Lock "cinder-a0fdd0b2-177a-4dc2-a8ed-a8fd5ffa8848-delete_snapshot" released by "delete_snapshot" :: held 4.489s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:07 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a 1G" returned: 0 in 0.966s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:07 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:07 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-5a528e1a-d483-4f3c-a7b3-546affe783af-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Lock "cinder-5a528e1a-d483-4f3c-a7b3-546affe783af-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Acquiring lock "cinder-quobyte-5a528e1a-d483-4f3c-a7b3-546affe783af" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-5a528e1a-d483-4f3c-a7b3-546affe783af" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e96ca7-6203-40c2-b7d5-e45f1b2c7c32]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:07 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af Jul 07 17:35:07 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:07 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:07 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a is being set with open permissions: ugo+rw Jul 07 17:35:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:07 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:07 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:08 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af" returned: 0 in 0.987s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:08 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af Jul 07 17:35:08 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:08 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.764s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:08 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info Jul 07 17:35:08 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:09 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5a528e1a-d483-4f3c-a7b3-546affe783af" returned: 0 in 0.756s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Lock "cinder-quobyte-5a528e1a-d483-4f3c-a7b3-546affe783af" released by "delete_volume" :: held 1.824s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Created reservations ['bb0a8c02-3fa2-4219-bb62-bbacee60f897', 'c6626850-e69c-43e6-ad3f-97c344c3c44c', 'af5b8371-4262-46e3-a4d5-b6498601c275', '66e5e44c-0d79-4588-954b-1751181be938'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:09 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info" returned: 0 in 0.750s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:09 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info is being set with open permissions: ugo+rw Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:09 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info Jul 07 17:35:09 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:09 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:35:09 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:10 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.info" returned: 0 in 0.834s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.161s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:10 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.814s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Deleted volume successfully. Jul 07 17:35:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-752fe0e6-6497-4911-8634-617cd0dc3a4e tempest-VolumesSnapshotListTestJSON-605435374 None] Create snapshot completed successfully Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bffb62c4-049d-4bf6-96de-e3a0627e905d tempest-VolumesExtendTest-695200568 None] Lock "cinder-5a528e1a-d483-4f3c-a7b3-546affe783af-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Creating offline snapshot 638c8cac-dcb1-4c3a-b035-be7418531424 of volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a34a30-402a-4405-a4ed-2b5ff2b06285]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:11 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:11 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:11 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.982s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:11 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 1G Jul 07 17:35:11 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:12 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 1G" returned: 0 in 0.873s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:12 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:12 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Flow 'volume_create_manager' (89919a89-f53b-4af7-94ce-73550edc1417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9706d57-9d3e-433d-a1aa-30fe653d1218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9706d57-9d3e-433d-a1aa-30fe653d1218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-856717828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7e4370-4274-4ca9-9061-7c24c970f026,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92a036911420478bb958f3da6997900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:13Z,use_quota=True,user_id='d29139ae7f7f491d99486f4520fa990a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e589088b-c034-450b-bea4-57a9c82a5429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e589088b-c034-450b-bea4-57a9c82a5429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4494693-da9d-4737-a9d0-c98e1cf75c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4494693-da9d-4737-a9d0-c98e1cf75c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7e4370-4274-4ca9-9061-7c24c970f026', 'volume_name': 'volume-0f7e4370-4274-4ca9-9061-7c24c970f026', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e96ae06-850d-4a7e-8946-d21b76d96174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e96ae06-850d-4a7e-8946-d21b76d96174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f08752-ce3c-474e-90f2-a823cb00b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:13 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Volume 0f7e4370-4274-4ca9-9061-7c24c970f026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7e4370-4274-4ca9-9061-7c24c970f026', 'volume_size': 1} Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:13 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:13 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 is being set with open permissions: ugo+rw Jul 07 17:35:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:13 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:13 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:14 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.676s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.520s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-856717828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7e4370-4274-4ca9-9061-7c24c970f026,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92a036911420478bb958f3da6997900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:13Z,use_quota=True,user_id='d29139ae7f7f491d99486f4520fa990a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Creating volume 0f7e4370-4274-4ca9-9061-7c24c970f026 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:14 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:35:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:14 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 1073741824 Jul 07 17:35:14 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:14 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d7e8f78a-0c52-4b1b-93f6-bf42d6522639 tempest-VolumesSnapshotListTestJSON-605435374 None] Create snapshot completed successfully Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:15 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 1073741824" returned: 0 in 0.915s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:15 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 Jul 07 17:35:15 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:15 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026" returned: 0 in 0.673s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Creating offline snapshot de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 of volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f08752-ce3c-474e-90f2-a823cb00b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7e4370-4274-4ca9-9061-7c24c970f026', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0221b9-7424-4e91-bfbb-bc31802a9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c44bce-ff73-4b1c-9768-e1043018c745]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:16 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Volume volume-0f7e4370-4274-4ca9-9061-7c24c970f026 (0f7e4370-4274-4ca9-9061-7c24c970f026): created successfully Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0221b9-7424-4e91-bfbb-bc31802a9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Flow 'volume_create_manager' (89919a89-f53b-4af7-94ce-73550edc1417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-375aab7a-8963-4519-a1cc-beb21ec1d3c9 tempest-VolumesListTestJSON-246390711 None] Created volume successfully. Jul 07 17:35:16 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:16 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:16 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:16 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 1G Jul 07 17:35:16 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Flow 'volume_create_manager' (372e0479-dd92-4aa8-87e0-1cb139e673df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97f46ad-3883-4f1f-9830-470b3c7708c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97f46ad-3883-4f1f-9830-470b3c7708c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-609136502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebf8052-325c-4ca4-a07c-76a4b0d957a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92a036911420478bb958f3da6997900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:17Z,use_quota=True,user_id='d29139ae7f7f491d99486f4520fa990a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e1d36e-001c-4089-9ab4-73f81f40dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e1d36e-001c-4089-9ab4-73f81f40dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b5244c-52c3-449f-9b5f-3daf7fad5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b5244c-52c3-449f-9b5f-3daf7fad5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebf8052-325c-4ca4-a07c-76a4b0d957a7', 'volume_name': 'volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2205f01c-bc48-43c2-bf60-9bd419e2db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2205f01c-bc48-43c2-bf60-9bd419e2db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f002c-655e-4371-90ba-bcdf229240d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Volume 8ebf8052-325c-4ca4-a07c-76a4b0d957a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7', 'volume_size': 1} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:17 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 1G" returned: 0 in 0.948s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:17 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 Jul 07 17:35:17 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:18 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:18 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 is being set with open permissions: ugo+rw Jul 07 17:35:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:18 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 Jul 07 17:35:18 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:19 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" returned: 0 in 0.682s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.243s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-609136502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebf8052-325c-4ca4-a07c-76a4b0d957a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92a036911420478bb958f3da6997900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:17Z,use_quota=True,user_id='d29139ae7f7f491d99486f4520fa990a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Creating volume 8ebf8052-325c-4ca4-a07c-76a4b0d957a7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:19 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:35:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:19 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 1073741824 Jul 07 17:35:19 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d6de4983-3865-4385-afd3-641f473aa19b tempest-VolumesSnapshotListTestJSON-605435374 None] Create snapshot completed successfully Jul 07 17:35:20 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 1073741824" returned: 0 in 0.810s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:20 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 Jul 07 17:35:20 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:20 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7" returned: 0 in 0.834s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f002c-655e-4371-90ba-bcdf229240d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f12145-a8dc-4b81-8abe-4e1c30501c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:20 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Volume volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 (8ebf8052-325c-4ca4-a07c-76a4b0d957a7): created successfully Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f12145-a8dc-4b81-8abe-4e1c30501c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Flow 'volume_create_manager' (372e0479-dd92-4aa8-87e0-1cb139e673df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d4a0ea1e-b40b-40d1-ae4e-b86ec791dbbe tempest-VolumesListTestJSON-246390711 None] Created volume successfully. Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Deleting offline snapshot de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 of volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] snapshot_file for this snap is: volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb173e8-c846-47f4-95e7-f073afd47a88]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:21 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 Jul 07 17:35:21 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Flow 'volume_create_manager' (0810e2ef-1285-4741-8570-5da545095b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e28d09c-50f9-4921-866a-1911ada00bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e28d09c-50f9-4921-866a-1911ada00bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1737284355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f02af82-2967-4d24-88b4-128d917a1853,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92a036911420478bb958f3da6997900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:22Z,use_quota=True,user_id='d29139ae7f7f491d99486f4520fa990a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:22 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b040fd8-9d97-4466-ae86-85932e035b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b040fd8-9d97-4466-ae86-85932e035b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be61e378-6b21-47a8-928d-49a8a5eae33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be61e378-6b21-47a8-928d-49a8a5eae33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f02af82-2967-4d24-88b4-128d917a1853', 'volume_name': 'volume-4f02af82-2967-4d24-88b4-128d917a1853', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7662d1-cd7b-450a-9fc9-f5c420bf0c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7662d1-cd7b-450a-9fc9-f5c420bf0c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd472ac-04c2-46f4-b15f-19d9cf49c95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:22 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Volume 4f02af82-2967-4d24-88b4-128d917a1853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f02af82-2967-4d24-88b4-128d917a1853', 'volume_size': 1} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1737284355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f02af82-2967-4d24-88b4-128d917a1853,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92a036911420478bb958f3da6997900b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:22Z,use_quota=True,user_id='d29139ae7f7f491d99486f4520fa990a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Creating volume 4f02af82-2967-4d24-88b4-128d917a1853 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:22 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" returned: 0 in 0.999s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:22 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 1073741824 Jul 07 17:35:22 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[172e2e63-7731-4b79-b6bd-c22e02198ad1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:22 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:22 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:23 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:23 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 Jul 07 17:35:23 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:23 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 1073741824" returned: 0 in 0.891s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:23 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 Jul 07 17:35:23 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:23 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853" returned: 0 in 0.683s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd472ac-04c2-46f4-b15f-19d9cf49c95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f02af82-2967-4d24-88b4-128d917a1853', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cced2585-000d-424c-bb05-05309a6d829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:23 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Volume volume-4f02af82-2967-4d24-88b4-128d917a1853 (4f02af82-2967-4d24-88b4-128d917a1853): created successfully Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cced2585-000d-424c-bb05-05309a6d829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Flow 'volume_create_manager' (0810e2ef-1285-4741-8570-5da545095b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:23 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fd2b043d-9a03-4ec3-85e6-15396ae6eefc tempest-VolumesListTestJSON-246390711 None] Created volume successfully. Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" returned: 0 in 0.836s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:23 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743 Jul 07 17:35:23 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:24 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" returned: 0 in 0.687s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743" released by "_delete_snapshot" :: held 3.431s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" released by "delete_snapshot" :: held 3.458s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Created reservations ['9a6e7445-a24a-4552-a50d-a80bd70b7256', '98c6a84e-1d53-4c80-8d8f-e9e6f99079cf', '02d8ef08-3d67-4e5e-8604-1755ccd7030d', 'f8ad1095-b1c0-4e1b-955e-a6944fb10c59'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Delete snapshot completed successfully. Jul 07 17:35:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e5d7725e-aecc-4f59-86c3-248d55a17bda tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-de6e0ff6-85f9-4c47-8eab-fcf4d1e5b743-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-638c8cac-dcb1-4c3a-b035-be7418531424-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-638c8cac-dcb1-4c3a-b035-be7418531424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-638c8cac-dcb1-4c3a-b035-be7418531424" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-638c8cac-dcb1-4c3a-b035-be7418531424" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Deleting offline snapshot 638c8cac-dcb1-4c3a-b035-be7418531424 of volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] snapshot_file for this snap is: volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf02335-0b3f-48ac-beed-9773e8e99fb0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:25 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:25 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:26 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.849s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Acquiring lock "cinder-4f02af82-2967-4d24-88b4-128d917a1853-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c254519-ac85-4f73-96cd-bd7e973642f4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Lock "cinder-4f02af82-2967-4d24-88b4-128d917a1853-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Acquiring lock "cinder-quobyte-4f02af82-2967-4d24-88b4-128d917a1853" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Lock "cinder-quobyte-4f02af82-2967-4d24-88b4-128d917a1853" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c112fa9-11e3-4052-83fc-2f2744474813]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:26 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:26 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:26 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 Jul 07 17:35:26 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:27 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.862s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:27 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:27 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:27 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853" returned: 0 in 0.838s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:27 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853 Jul 07 17:35:27 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:28 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4f02af82-2967-4d24-88b4-128d917a1853" returned: 0 in 0.685s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Lock "cinder-quobyte-4f02af82-2967-4d24-88b4-128d917a1853" released by "delete_volume" :: held 1.583s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:28 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.815s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:28 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424 Jul 07 17:35:28 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Created reservations ['fc3fd9f6-8a3b-444e-97c5-55721e5d81f4', 'e263ab08-1e32-48a1-bd2c-0baed7790d16', '87e61f94-e9b8-4e3c-ad02-c81d93bd819b', '2256d181-e081-49a3-9936-025b8b2812bb'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:28 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:35:28 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca02388c-bdb8-44ac-839f-8e4bccae00ee]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Acquiring lock "cinder-8ebf8052-325c-4ca4-a07c-76a4b0d957a7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Lock "cinder-8ebf8052-325c-4ca4-a07c-76a4b0d957a7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:28 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.638c8cac-dcb1-4c3a-b035-be7418531424" returned: 0 in 0.730s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:28 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 Jul 07 17:35:28 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Acquiring lock "cinder-quobyte-8ebf8052-325c-4ca4-a07c-76a4b0d957a7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-638c8cac-dcb1-4c3a-b035-be7418531424" released by "_delete_snapshot" :: held 3.417s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Lock "cinder-quobyte-8ebf8052-325c-4ca4-a07c-76a4b0d957a7" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" released by "delete_snapshot" :: held 3.458s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa8c05a-684e-44b0-8f9a-c6a4405b9b37]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:29 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.743s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Deleted volume successfully. Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ab7464c1-af73-4aa4-b4a1-0b7e80ed3ede tempest-VolumesListTestJSON-246390711 None] Lock "cinder-4f02af82-2967-4d24-88b4-128d917a1853-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Created reservations ['2afe2482-6e43-464d-9001-4cdf1b9d1042', '73b28518-3012-4196-89e2-8f7e53d56000', '6a365b00-4d39-45d6-9060-c7d5be208bbf', '30141d10-cc20-4ea6-a411-e51c5f5e7375'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:29 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 Jul 07 17:35:29 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Delete snapshot completed successfully. Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b7c3b6e6-7db7-4692-92ec-f0f05e72086d tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-638c8cac-dcb1-4c3a-b035-be7418531424-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:29 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" returned: 0 in 0.934s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0daca030-cb74-4d95-8b0b-13e06c3646cd', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:35:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-1436b751-23ce-423e-a31a-72c238180ba1 req-832d7835-5e1c-4059-a39f-2955c34049cb tempest-TestServerVolumeAttachmentScenario-274426055 None] attachment_update completed successfully. Jul 07 17:35:29 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7" returned: 0 in 0.840s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-46d9b471-77b9-44f8-a53e-670d2f01693a-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:29 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7 Jul 07 17:35:29 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-46d9b471-77b9-44f8-a53e-670d2f01693a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-46d9b471-77b9-44f8-a53e-670d2f01693a" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-46d9b471-77b9-44f8-a53e-670d2f01693a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Deleting offline snapshot 46d9b471-77b9-44f8-a53e-670d2f01693a of volume 0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] snapshot_file for this snap is: volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[54456dab-609f-4196-b417-f019375ae8bc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:30 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:30 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:30 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8ebf8052-325c-4ca4-a07c-76a4b0d957a7" returned: 0 in 0.709s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Lock "cinder-quobyte-8ebf8052-325c-4ca4-a07c-76a4b0d957a7" released by "delete_volume" :: held 1.592s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Created reservations ['05ffd504-0647-4fad-b162-fbda6e579295', 'dc8fc895-9928-4b13-ae35-86410c1e617a', 'e9c2667e-b06a-4226-9615-c3c63f742ca7', '5db3e009-af92-462f-aaa1-71dd663008d8'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:30 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:35:30 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:30 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.813s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1321c3-e9ed-409d-9a12-551a560a96f2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:30 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 Jul 07 17:35:30 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Acquiring lock "cinder-0f7e4370-4274-4ca9-9061-7c24c970f026-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Lock "cinder-0f7e4370-4274-4ca9-9061-7c24c970f026-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Acquiring lock "cinder-quobyte-0f7e4370-4274-4ca9-9061-7c24c970f026" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Lock "cinder-quobyte-0f7e4370-4274-4ca9-9061-7c24c970f026" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b573875-1878-468f-96f9-db5ee49ff0c2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:31 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 Jul 07 17:35:31 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:31 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.804s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Deleted volume successfully. Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-970cc962-7fd0-4898-ac5d-5ca7b9b58daa tempest-VolumesListTestJSON-246390711 None] Lock "cinder-8ebf8052-325c-4ca4-a07c-76a4b0d957a7-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:31 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" returned: 0 in 0.920s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:31 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:31 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:32 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026" returned: 0 in 0.782s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:32 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026 Jul 07 17:35:32 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:32 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.775s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:32 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a Jul 07 17:35:32 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:32 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:35:32 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:32 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0f7e4370-4274-4ca9-9061-7c24c970f026" returned: 0 in 0.677s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Lock "cinder-quobyte-0f7e4370-4274-4ca9-9061-7c24c970f026" released by "delete_volume" :: held 1.524s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Created reservations ['0390189e-5cb0-4c43-a771-3890b1fec8b4', 'fe8db8ee-1583-4f2f-b35d-e23be459d686', 'af8246be-8e24-4255-a52f-547d54f0c8f7', '7c666aee-fbde-4fbc-bb34-89d7d5d30cfa'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:32 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:35:33 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:33 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9.46d9b471-77b9-44f8-a53e-670d2f01693a" returned: 0 in 0.730s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-46d9b471-77b9-44f8-a53e-670d2f01693a" released by "_delete_snapshot" :: held 3.366s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" released by "delete_snapshot" :: held 3.392s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Created reservations ['62b9205e-ab49-4757-99a1-7684d0691ac9', '7f4878e7-3fdb-4a7b-b07c-581aa7e578bd', '6edc65d2-46a7-42f4-81b2-6aa6aae9f0e3', '8f84b56c-dd2b-48e8-a48b-a2191584dfcd'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Delete snapshot completed successfully. Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-00cc0ce7-d66c-4d76-b487-ef80644e75e6 tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-46d9b471-77b9-44f8-a53e-670d2f01693a-delete_snapshot" released by "delete_snapshot" :: held 3.588s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:33 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:35:33 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.766s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Deleted volume successfully. Jul 07 17:35:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7592be08-e053-4490-a90b-34f034ecaae0 tempest-VolumesListTestJSON-246390711 None] Lock "cinder-0f7e4370-4274-4ca9-9061-7c24c970f026-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14e3931-c1a9-4ee4-a88a-f52a7095cc96]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:34 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 Jul 07 17:35:34 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:35 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" returned: 0 in 0.888s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:35 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9 Jul 07 17:35:35 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:35 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" returned: 0 in 0.743s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-quobyte-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9" released by "delete_volume" :: held 1.709s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:35 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Created reservations ['7880e031-7379-4e70-951f-28b9f31357c9', 'd3c7474e-5951-4255-be57-fd04be199174', '04815ee1-53b6-4e0e-89f6-4b5f47f90022', '81af073c-0b33-472f-87d0-ef9420ad6342'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:36 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:35:36 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:36 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.841s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:36 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Deleted volume successfully. Jul 07 17:35:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bca9a407-7941-43a8-be7d-a74aa546b80c tempest-VolumesSnapshotListTestJSON-605435374 None] Lock "cinder-0fa3c8b1-fb12-4a9f-a787-3d9f1017c4a9-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:41 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=123,cinder:SELECT=97,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:35:41 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=107,cinder:INSERT=39,cinder:UPDATE=119,cinder:DELETE=11 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:35:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:41 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae964be7-a93c-45ba-a741-5a78eecf0763]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:41 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 Jul 07 17:35:41 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:42 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" returned: 0 in 1.049s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.086s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bfda173-d93b-4f24-a133-d8f47c14f3d6', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:35:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-6e0f3568-0046-4273-ae75-e68f42f671a9 req-31c914a1-70a6-4aea-8d96-efef9ef15de7 tempest-TestServerVolumeAttachmentScenario-274426055 None] attachment_update completed successfully. Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Flow 'volume_create_manager' (f5c21ad9-2059-4e58-811a-910436959063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612fef4d-dfec-4c49-b794-6e4e776af027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612fef4d-dfec-4c49-b794-6e4e776af027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef76a2c-62b0-4703-968d-6050668bc62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2517c86be44a6195c4bea42a2b39bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:44Z,use_quota=True,user_id='ecf2ec09ccdf4396acdfa3240f9c29cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46b7ad17-74f5-475e-9d80-b5eb7e45f2bd),volume_type_id=46b7ad17-74f5-475e-9d80-b5eb7e45f2bd)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf0a47d-4368-41ae-9cb2-cfdd1462fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf0a47d-4368-41ae-9cb2-cfdd1462fc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2c7c5b-28fc-463f-9c7a-c785dc7a9c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:43 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2c7c5b-28fc-463f-9c7a-c785dc7a9c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cef76a2c-62b0-4703-968d-6050668bc62e', 'volume_name': 'volume-cef76a2c-62b0-4703-968d-6050668bc62e', 'volume_size': 1, 'image_id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36c9cd1b-c31d-4777-8a62-9a188cff901e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3027a4b21fc8c0d652c7b2573221b825', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b2517c86be44a6195c4bea42a2b39bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a3213a7523430c7aaaaaf97653b9bdef47bd96ab4cd410747e0c45de7e31e3a25f83c5ff9d2554d9a45f4c65512538690d35d5c27da5529a83b932d7293be23', 'id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'created_at': datetime.datetime(2026, 7, 7, 15, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36c9cd1b-c31d-4777-8a62-9a188cff901e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d5b6c2-93cb-400c-8af5-93b4f769fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d5b6c2-93cb-400c-8af5-93b4f769fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3500f6-af90-4c66-8649-764f41c8adf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Volume cef76a2c-62b0-4703-968d-6050668bc62e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cef76a2c-62b0-4703-968d-6050668bc62e', 'volume_size': 1, 'image_id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36c9cd1b-c31d-4777-8a62-9a188cff901e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3027a4b21fc8c0d652c7b2573221b825', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b2517c86be44a6195c4bea42a2b39bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a3213a7523430c7aaaaaf97653b9bdef47bd96ab4cd410747e0c45de7e31e3a25f83c5ff9d2554d9a45f4c65512538690d35d5c27da5529a83b932d7293be23', 'id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'created_at': datetime.datetime(2026, 7, 7, 15, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36c9cd1b-c31d-4777-8a62-9a188cff901e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Trying to clone cef76a2c-62b0-4703-968d-6050668bc62e from image 36c9cd1b-c31d-4777-8a62-9a188cff901e at location (None, [{'url': 'file:///opt/stack/data/glance/images/36c9cd1b-c31d-4777-8a62-9a188cff901e', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:35:44 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c60b96e-4fe9-4926-bd51-d2d63487bef9]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:44 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD Jul 07 17:35:44 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:45 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD" returned: 0 in 1.002s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:45 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD Jul 07 17:35:45 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:46 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD" returned: 1 in 0.823s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Temporary image 36c9cd1b-c31d-4777-8a62-9a188cff901e is fetched for user ecf2ec09ccdf4396acdfa3240f9c29cf. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896b8ac-d517-4c39-aa57-ed01f845b9ce]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (09aac0cd-a5de-4c38-b9fe-ccbb71f5e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:46 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD Jul 07 17:35:46 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e98be6-03d9-40bc-a7fe-4b46956564c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e98be6-03d9-40bc-a7fe-4b46956564c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-977973840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b8f70e-326d-4475-9dc0-5011199f95ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:46Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786076ba-1bbe-411b-acf4-ad54eceec272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786076ba-1bbe-411b-acf4-ad54eceec272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4df7d1-8484-4dbc-961b-bff67fd755e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4df7d1-8484-4dbc-961b-bff67fd755e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b8f70e-326d-4475-9dc0-5011199f95ad', 'volume_name': 'volume-b6b8f70e-326d-4475-9dc0-5011199f95ad', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933bd249-059a-40c5-a899-5997137536c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933bd249-059a-40c5-a899-5997137536c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010bbcd0-258a-4948-bf88-f1d963e796d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Volume b6b8f70e-326d-4475-9dc0-5011199f95ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b8f70e-326d-4475-9dc0-5011199f95ad', 'volume_size': 1} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-977973840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b8f70e-326d-4475-9dc0-5011199f95ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:46Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Creating volume b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:46 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:35:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:46 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad 1073741824 Jul 07 17:35:46 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:47 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:47 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD Jul 07 17:35:47 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:47 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad 1073741824" returned: 0 in 0.870s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:47 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad Jul 07 17:35:47 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:47 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD" returned: 1 in 0.735s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:35:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:48 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad" returned: 0 in 0.778s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef76a2c-62b0-4703-968d-6050668bc62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2517c86be44a6195c4bea42a2b39bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:44Z,use_quota=True,user_id='ecf2ec09ccdf4396acdfa3240f9c29cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46b7ad17-74f5-475e-9d80-b5eb7e45f2bd),volume_type_id=46b7ad17-74f5-475e-9d80-b5eb7e45f2bd)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Creating volume cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:48 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:48 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e 1073741824 Jul 07 17:35:48 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010bbcd0-258a-4948-bf88-f1d963e796d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b8f70e-326d-4475-9dc0-5011199f95ad', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4db9f63-5291-492e-b149-b75618b567e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:48 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Volume volume-b6b8f70e-326d-4475-9dc0-5011199f95ad (b6b8f70e-326d-4475-9dc0-5011199f95ad): created successfully Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4db9f63-5291-492e-b149-b75618b567e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (09aac0cd-a5de-4c38-b9fe-ccbb71f5e63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-29d23ad3-ae12-4aec-b194-b56344f22059 tempest-VolumesSnapshotTestJSON-218485035 None] Created volume successfully. Jul 07 17:35:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-37902df7-6036-49f5-a5a8-9551828c3b53 req-302d26da-da32-4476-b984-ba994efdd8ab tempest-TestServerVolumeAttachmentScenario-274426055 None] Terminate volume connection completed successfully. Jul 07 17:35:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-37902df7-6036-49f5-a5a8-9551828c3b53 req-302d26da-da32-4476-b984-ba994efdd8ab tempest-TestServerVolumeAttachmentScenario-274426055 None] Deleting attachment 9bfda173-d93b-4f24-a133-d8f47c14f3d6. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:35:49 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e 1073741824" returned: 0 in 1.059s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:49 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:49 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:50 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 0 in 0.739s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.130s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Creating offline snapshot 89209f6b-0f08-4c77-b045-ceb7f3851bd6 of volume b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8377a-8336-4be9-ac98-258c53a9e2fc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Attempting download of 36c9cd1b-c31d-4777-8a62-9a188cff901e ((None, [{'url': 'file:///opt/stack/data/glance/images/36c9cd1b-c31d-4777-8a62-9a188cff901e', 'metadata': {}}])) to volume cef76a2c-62b0-4703-968d-6050668bc62e. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[220897a4-a5bd-422a-a97b-eca17e814405]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:50 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad Jul 07 17:35:50 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:50 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t Jul 07 17:35:50 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:50 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t" returned: 0 in 0.809s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:51 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad" returned: 0 in 0.941s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:51 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 1G Jul 07 17:35:51 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:51 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t Jul 07 17:35:51 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:51 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t" returned: 1 in 0.806s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36c9cd1b-c31d-4777-8a62-9a188cff901e_is_rfr2t' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f222f-d83a-44c0-8e76-4de8bde05a19]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:51 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 1G" returned: 0 in 0.856s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b8f70e-326d-4475-9dc0-5011199f95ad -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:51 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD Jul 07 17:35:51 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:51 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b8f70e-326d-4475-9dc0-5011199f95ad -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 Jul 07 17:35:51 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:52 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:52 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b8f70e-326d-4475-9dc0-5011199f95ad -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6" returned: 0 in 0.703s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:52 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 is being set with open permissions: ugo+rw Jul 07 17:35:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:52 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 Jul 07 17:35:52 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:52 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD Jul 07 17:35:52 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-e4267f44-e609-47c6-9a15-966c69d714ff req-c9441b11-0787-4c45-acca-70efa746d956 tempest-TestServerVolumeAttachmentScenario-274426055 None] Terminate volume connection completed successfully. Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e4267f44-e609-47c6-9a15-966c69d714ff req-c9441b11-0787-4c45-acca-70efa746d956 tempest-TestServerVolumeAttachmentScenario-274426055 None] Deleting attachment 0daca030-cb74-4d95-8b0b-13e06c3646cd. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:35:53 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6" returned: 0 in 0.736s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:53 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD" returned: 1 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] 36c9cd1b-c31d-4777-8a62-9a188cff901e was raw, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:35:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:53 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info Jul 07 17:35:53 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:53 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:53 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:54 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info" returned: 0 in 0.699s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:54 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info is being set with open permissions: ugo+rw Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:54 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info Jul 07 17:35:54 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:54 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36c9cd1b-c31d-4777-8a62-9a188cff901e_hcsc8d4gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:35:54 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:54 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e 1G Jul 07 17:35:54 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:54 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.info" returned: 0 in 0.711s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.769s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:54 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1f72d059-f4a4-49fe-b823-5cf31e641c91 tempest-VolumesSnapshotTestJSON-218485035 None] Create snapshot completed successfully Jul 07 17:35:55 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e 1G" returned: 0 in 0.744s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b1f89-e131-4e37-92c1-542e2d1ab21f]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:55 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:55 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-89209f6b-0f08-4c77-b045-ceb7f3851bd6-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-89209f6b-0f08-4c77-b045-ceb7f3851bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-b6b8f70e-326d-4475-9dc0-5011199f95ad" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-b6b8f70e-326d-4475-9dc0-5011199f95ad" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-89209f6b-0f08-4c77-b045-ceb7f3851bd6" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-89209f6b-0f08-4c77-b045-ceb7f3851bd6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Deleting offline snapshot 89209f6b-0f08-4c77-b045-ceb7f3851bd6 of volume b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] snapshot_file for this snap is: volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6de19a-40d6-4376-ad48-274f8565cf4f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:55 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 Jul 07 17:35:55 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:55 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 0 in 0.842s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:56 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:56 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:56 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b8f70e-326d-4475-9dc0-5011199f95ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[22726bce-b162-4aa2-94b5-47fffa3bd568]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:56 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad Jul 07 17:35:56 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:56 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 1 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Downloaded image 36c9cd1b-c31d-4777-8a62-9a188cff901e ((None, [{'url': 'file:///opt/stack/data/glance/images/36c9cd1b-c31d-4777-8a62-9a188cff901e', 'metadata': {}}])) to volume cef76a2c-62b0-4703-968d-6050668bc62e successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Temporary image 36c9cd1b-c31d-4777-8a62-9a188cff901e for user ecf2ec09ccdf4396acdfa3240f9c29cf is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Marking volume cef76a2c-62b0-4703-968d-6050668bc62e as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Copying metadata from image 36c9cd1b-c31d-4777-8a62-9a188cff901e to cef76a2c-62b0-4703-968d-6050668bc62e. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Creating volume glance metadata for volume cef76a2c-62b0-4703-968d-6050668bc62e backed by image 36c9cd1b-c31d-4777-8a62-9a188cff901e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3027a4b21fc8c0d652c7b2573221b825', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3500f6-af90-4c66-8649-764f41c8adf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef76a2c-62b0-4703-968d-6050668bc62e', 'volume_size': 1, 'image_id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36c9cd1b-c31d-4777-8a62-9a188cff901e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3027a4b21fc8c0d652c7b2573221b825', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b2517c86be44a6195c4bea42a2b39bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a3213a7523430c7aaaaaf97653b9bdef47bd96ab4cd410747e0c45de7e31e3a25f83c5ff9d2554d9a45f4c65512538690d35d5c27da5529a83b932d7293be23', 'id': '36c9cd1b-c31d-4777-8a62-9a188cff901e', 'created_at': datetime.datetime(2026, 7, 7, 15, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36c9cd1b-c31d-4777-8a62-9a188cff901e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5342f306-5442-43c9-bf27-1039a0ab7fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:56 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Volume volume-cef76a2c-62b0-4703-968d-6050668bc62e (cef76a2c-62b0-4703-968d-6050668bc62e): created successfully Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5342f306-5442-43c9-bf27-1039a0ab7fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Flow 'volume_create_manager' (f5c21ad9-2059-4e58-811a-910436959063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-12c94998-468d-4201-9e85-fc01fcc47ed7 tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Created volume successfully. Jul 07 17:35:57 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad" returned: 0 in 0.905s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:57 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 Jul 07 17:35:57 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Acquiring lock "cinder-cef76a2c-62b0-4703-968d-6050668bc62e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "cinder-cef76a2c-62b0-4703-968d-6050668bc62e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Acquiring lock "cinder-quobyte-cef76a2c-62b0-4703-968d-6050668bc62e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "cinder-quobyte-cef76a2c-62b0-4703-968d-6050668bc62e" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ad01b-0494-408c-b064-4169b3e0cc56]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:58 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:58 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:58 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6" returned: 0 in 0.865s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:58 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6 Jul 07 17:35:58 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:58 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 0 in 0.909s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:58 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:58 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:59 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad.89209f6b-0f08-4c77-b045-ceb7f3851bd6" returned: 0 in 0.846s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-89209f6b-0f08-4c77-b045-ceb7f3851bd6" released by "_delete_snapshot" :: held 3.549s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-b6b8f70e-326d-4475-9dc0-5011199f95ad" released by "delete_snapshot" :: held 3.576s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['e581f08d-cc7d-4ed8-8aea-02f6eedae549', 'e391b980-c161-4b56-bb2c-7c85babdf8f4', '7d2bb59e-6dfd-433b-8d42-8877173ffa77', 'a0ef4aa8-fc57-45f5-ad2c-9d6d1e68c348'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Delete snapshot completed successfully. Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1c42b031-4157-4142-b7b5-4095f8190717 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-89209f6b-0f08-4c77-b045-ceb7f3851bd6-delete_snapshot" released by "delete_snapshot" :: held 3.786s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:59 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 1 in 0.852s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:35:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:59 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e Jul 07 17:35:59 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (e5998f8f-f862-4461-902d-67606a08565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a121195-438c-445f-a588-8113a3361f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a121195-438c-445f-a588-8113a3361f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-350800687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57983ed1-305a-4992-a6ad-20fe8f8ea674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:00Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2d5729-dd80-4e88-afe7-3f96f3edf4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2d5729-dd80-4e88-afe7-3f96f3edf4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984b5d01-d8b0-46f1-99ad-f163daf1d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984b5d01-d8b0-46f1-99ad-f163daf1d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57983ed1-305a-4992-a6ad-20fe8f8ea674', 'volume_name': 'volume-57983ed1-305a-4992-a6ad-20fe8f8ea674', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d765a4c8-5d71-4ec0-80b1-9bfde59b7d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d765a4c8-5d71-4ec0-80b1-9bfde59b7d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2eca66-b332-4213-85fd-3469433d34a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Volume 57983ed1-305a-4992-a6ad-20fe8f8ea674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57983ed1-305a-4992-a6ad-20fe8f8ea674', 'volume_size': 1} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-350800687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57983ed1-305a-4992-a6ad-20fe8f8ea674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:00Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Creating volume 57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:00 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 1073741824 Jul 07 17:36:00 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:00 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cef76a2c-62b0-4703-968d-6050668bc62e" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "cinder-quobyte-cef76a2c-62b0-4703-968d-6050668bc62e" released by "delete_volume" :: held 2.623s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:00 devstack cinder-volume[87251]: WARNING cinder.quota [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:36:00 devstack cinder-volume[87251]: WARNING cinder.quota [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Created reservations ['8f48f0a5-bf76-4f20-b045-263d64210897', '9c83a0cb-c5a6-422d-9c78-d8a811dbbc45', 'feb52c8b-c86d-46dc-8f57-f1b8601c8b9d', '0b6f1705-b528-4493-8d50-cbed02432404'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:00 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:00 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:01 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.773s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:01 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Deleted volume successfully. Jul 07 17:36:01 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 1073741824" returned: 0 in 0.992s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1fe9c61-ce1c-4a1c-a916-3c511cb8300f tempest-VolumeAndVolumeTypeFromImageTest-404993277 None] Lock "cinder-cef76a2c-62b0-4703-968d-6050668bc62e-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:01 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:01 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:02 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 0.743s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2eca66-b332-4213-85fd-3469433d34a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57983ed1-305a-4992-a6ad-20fe8f8ea674', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a576f1d-1f4c-4096-89ea-c6fc3ffe8708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Volume volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 (57983ed1-305a-4992-a6ad-20fe8f8ea674): created successfully Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a576f1d-1f4c-4096-89ea-c6fc3ffe8708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (e5998f8f-f862-4461-902d-67606a08565e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e9123285-3241-4ff9-bd8e-c1205a7459a6 tempest-VolumesSnapshotTestJSON-218485035 None] Created volume successfully. Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Creating offline snapshot ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 of volume 57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[070d8fec-7bbb-4ad2-8492-e8fbe4ad7daf]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:02 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:02 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:03 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 0.878s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:03 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 1G Jul 07 17:36:03 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "cinder-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "cinder-quobyte-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-quobyte-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f172758-a27a-430d-848b-22a2047eea34]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:04 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 Jul 07 17:36:04 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:04 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 1G" returned: 0 in 0.946s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:04 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 Jul 07 17:36:04 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:04 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" returned: 0 in 0.813s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:04 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94 Jul 07 17:36:04 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:05 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" returned: 0 in 0.722s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:05 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 is being set with open permissions: ugo+rw Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:05 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 Jul 07 17:36:05 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:05 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" returned: 0 in 0.694s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-quobyte-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94" released by "delete_volume" :: held 1.574s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Created reservations ['82ec72f3-02f6-4ecd-93e6-61ad480772b1', '94b7e7b4-1b1c-4f46-8341-736a3fe1efba', 'b036731b-88c0-44f4-862c-883c280684ba', '3523e18e-b7df-4601-aa55-b2a056dd9853'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:05 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:05 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:06 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:06 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info Jul 07 17:36:06 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "cinder-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "cinder-quobyte-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-quobyte-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9a0053-5444-4a9f-9c5b-2570ade54c1a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:06 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Deleted volume successfully. Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (444eb97f-e328-4fba-8c30-1c373ce3b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6747bc06-5ca6-4191-9dab-26a4ad773197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:06 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 Jul 07 17:36:06 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6747bc06-5ca6-4191-9dab-26a4ad773197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844653576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c44f33d-6d48-46a8-8d62-2f21e53d193f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:06Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6d2596-5727-41de-9731-f731c4de45d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6d2596-5727-41de-9731-f731c4de45d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f861f825-64b5-48b9-9516-88ca04072630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f861f825-64b5-48b9-9516-88ca04072630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c44f33d-6d48-46a8-8d62-2f21e53d193f', 'volume_name': 'volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6efce1-6628-4cf6-b67e-b201b4bf7b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6efce1-6628-4cf6-b67e-b201b4bf7b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32814d93-1c8d-4e74-9761-d01d20706e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:06 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume 6c44f33d-6d48-46a8-8d62-2f21e53d193f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f', 'volume_size': 1} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-879254c2-1dab-4005-800b-ba825cc134aa tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-45d7d1a3-3e8e-404f-9027-8ab2e88d6a94-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:06 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info" returned: 0 in 0.826s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info is being set with open permissions: ugo+rw Jul 07 17:36:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:06 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info Jul 07 17:36:06 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:07 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" returned: 0 in 0.791s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:07 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7 Jul 07 17:36:07 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:07 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.info" returned: 0 in 0.653s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844653576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c44f33d-6d48-46a8-8d62-2f21e53d193f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:06Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating volume 6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:07 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:07 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f 1073741824 Jul 07 17:36:07 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e1871c88-a5fa-4a4f-80b2-fcaa66a4505b tempest-VolumesSnapshotTestJSON-218485035 None] Create snapshot completed successfully Jul 07 17:36:07 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" returned: 0 in 0.669s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-quobyte-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7" released by "delete_volume" :: held 1.515s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Created reservations ['295f6aad-33e2-4762-a559-0c24772fe8e0', 'bc483dfc-f982-4a33-959f-fe173e50001e', '03912229-309a-460c-a00b-ed905922e692', 'df0eaac2-ef4e-4d85-a512-4a6982d3677a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:08 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:08 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:08 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f 1073741824" returned: 0 in 1.012s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (cf868e5c-42c1-46fd-90e2-7295398bc725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e572709-f6e1-4df3-83a8-6ffd377aff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e572709-f6e1-4df3-83a8-6ffd377aff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-137957859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7620205f-7360-4d7f-afa2-498b7739f221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ef54c9d5-0fd0-4f15-9be7-9313665ed5e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:08Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08ca8cf-e18f-4a97-87a0-2d274f0af62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08ca8cf-e18f-4a97-87a0-2d274f0af62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5841e389-6fde-40f1-b33c-b131074972f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5841e389-6fde-40f1-b33c-b131074972f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7620205f-7360-4d7f-afa2-498b7739f221', 'volume_name': 'volume-7620205f-7360-4d7f-afa2-498b7739f221', 'volume_size': 2, 'snapshot_id': 'ef54c9d5-0fd0-4f15-9be7-9313665ed5e0'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a806a0-8369-4316-8419-784d1a69f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a806a0-8369-4316-8419-784d1a69f32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fb2b3e-6012-4a5b-a902-806d15b2b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Volume 7620205f-7360-4d7f-afa2-498b7739f221: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7620205f-7360-4d7f-afa2-498b7739f221', 'volume_size': 2, 'snapshot_id': 'ef54c9d5-0fd0-4f15-9be7-9313665ed5e0'} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:08 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f Jul 07 17:36:08 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:08 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Deleted volume successfully. Jul 07 17:36:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-30180240-7329-4c50-aa1a-6ebd5eae2d20 tempest-TestServerVolumeAttachmentScenario-274426055 None] Lock "cinder-2a9a66c8-16b8-40e1-a1a9-62b79a6c6ea7-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:09 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f" returned: 0 in 0.739s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.733s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0-7620205f-7360-4d7f-afa2-498b7739f221" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32814d93-1c8d-4e74-9761-d01d20706e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963e72ec-e7b5-4a94-b846-7c5a9ce36178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0-7620205f-7360-4d7f-afa2-498b7739f221" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Creating volume 7620205f-7360-4d7f-afa2-498b7739f221 from snapshot ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-7620205f-7360-4d7f-afa2-498b7739f221" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f (6c44f33d-6d48-46a8-8d62-2f21e53d193f): created successfully Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963e72ec-e7b5-4a94-b846-7c5a9ce36178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (444eb97f-e328-4fba-8c30-1c373ce3b898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-7620205f-7360-4d7f-afa2-498b7739f221" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] snapshot: ef54c9d5-0fd0-4f15-9be7-9313665ed5e0, volume: 7620205f-7360-4d7f-afa2-498b7739f221, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:36:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1ff0967d-3fea-4198-ae13-833129b8799d tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created volume successfully. Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[848709ad-f811-4330-a2e2-e7403bf6972e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:09 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 Jul 07 17:36:09 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:10 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" returned: 0 in 0.790s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57983ed1-305a-4992-a6ad-20fe8f8ea674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a679e8-4eeb-44de-9054-e7fecfe92401]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:10 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:10 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:11 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 0.809s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:11 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:36:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:11 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 Jul 07 17:36:11 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:16 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221" returned: 0 in 5.196s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1745d-5c19-40f9-8d45-3adf3273db18]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:16 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:16 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:17 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 0.964s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:17 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:36:17 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Converted 1024.00 MB image at 197.04 MB/s Jul 07 17:36:17 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 is being set with open permissions: ugo+rw Jul 07 17:36:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:17 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 Jul 07 17:36:17 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:18 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221" returned: 0 in 0.706s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-7620205f-7360-4d7f-afa2-498b7739f221" released by "_copy_volume_from_snapshot" :: held 8.571s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0-7620205f-7360-4d7f-afa2-498b7739f221" released by "_create_volume_from_snapshot" :: held 8.622s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.655s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.184s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating offline snapshot 596ba433-6887-47d3-91e2-e77d20ce67f3 of volume 6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66a6613-3a4c-4ff0-99ce-ffb5e180239e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fb2b3e-6012-4a5b-a902-806d15b2b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7620205f-7360-4d7f-afa2-498b7739f221', 'volume_size': 2, 'snapshot_id': 'ef54c9d5-0fd0-4f15-9be7-9313665ed5e0'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fc80b2-87ba-4bea-bc45-78bc27a2672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Volume volume-7620205f-7360-4d7f-afa2-498b7739f221 (7620205f-7360-4d7f-afa2-498b7739f221): created successfully Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fc80b2-87ba-4bea-bc45-78bc27a2672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (cf868e5c-42c1-46fd-90e2-7295398bc725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-45727f2f-a766-4462-bd95-9539ba2960dc tempest-VolumesSnapshotTestJSON-218485035 None] Created volume successfully. Jul 07 17:36:18 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f Jul 07 17:36:18 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-7620205f-7360-4d7f-afa2-498b7739f221-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-7620205f-7360-4d7f-afa2-498b7739f221-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-7620205f-7360-4d7f-afa2-498b7739f221" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-7620205f-7360-4d7f-afa2-498b7739f221" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0b83a-5b08-4e93-85e1-a58e793a382d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:18 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 Jul 07 17:36:18 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:19 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f" returned: 0 in 0.896s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:19 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 1G Jul 07 17:36:19 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:19 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:19 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221 Jul 07 17:36:19 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:19 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 1G" returned: 0 in 0.900s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:19 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 Jul 07 17:36:19 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:20 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-7620205f-7360-4d7f-afa2-498b7739f221" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-7620205f-7360-4d7f-afa2-498b7739f221" released by "delete_volume" :: held 1.663s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['b6d99476-8b50-421a-a18f-c05eb6dff290', '83fa577e-5986-409b-81e3-e86688412e69', '25d2bce0-43a0-447e-baf1-5bc91fc95329', '3447ab1c-da6f-4253-aafa-cf46cfe41a71'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:20 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:20 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:20 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3" returned: 0 in 0.772s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:20 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 is being set with open permissions: ugo+rw Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:20 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 Jul 07 17:36:20 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-57983ed1-305a-4992-a6ad-20fe8f8ea674" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-57983ed1-305a-4992-a6ad-20fe8f8ea674" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Deleting offline snapshot ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 of volume 57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] snapshot_file for this snap is: volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a706a4-3a84-4f19-91d7-2a6a0e9e723b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:21 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.740s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Deleted volume successfully. Jul 07 17:36:21 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 Jul 07 17:36:21 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6097f345-9a71-4a5f-b450-c9ab4db580e0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-7620205f-7360-4d7f-afa2-498b7739f221-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:21 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3" returned: 0 in 0.830s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:21 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info Jul 07 17:36:21 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:21 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" returned: 0 in 0.869s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57983ed1-305a-4992-a6ad-20fe8f8ea674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[922fff14-3d07-429b-8928-e0a4d41da253]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:22 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:22 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:22 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info" returned: 0 in 0.751s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:22 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info is being set with open permissions: ugo+rw Jul 07 17:36:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:22 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info Jul 07 17:36:22 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:22 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 0.883s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:22 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 Jul 07 17:36:22 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:23 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.info" returned: 0 in 0.897s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.160s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-aa6a28d7-9b02-41e7-8678-65fbea171864 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Create snapshot completed successfully Jul 07 17:36:23 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:23 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0 Jul 07 17:36:23 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (ccddba04-cd29-470f-8fd8-0e52bb7f9eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d59d8a-96c4-41ef-b7f7-333faaee877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d59d8a-96c4-41ef-b7f7-333faaee877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-385546420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ae1ffb-44a7-4972-9a31-53d541d5be01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:24Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464d604c-1640-4e41-88e2-9b9545357525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464d604c-1640-4e41-88e2-9b9545357525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85655d87-1ffc-4897-ada7-038c46dd5892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85655d87-1ffc-4897-ada7-038c46dd5892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61ae1ffb-44a7-4972-9a31-53d541d5be01', 'volume_name': 'volume-61ae1ffb-44a7-4972-9a31-53d541d5be01', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d19966-4357-42ea-8972-28183b9e78b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d19966-4357-42ea-8972-28183b9e78b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91329113-4fec-4e0b-b6cf-c1c2fd6634f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume 61ae1ffb-44a7-4972-9a31-53d541d5be01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61ae1ffb-44a7-4972-9a31-53d541d5be01', 'volume_size': 1} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-385546420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ae1ffb-44a7-4972-9a31-53d541d5be01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:24Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating volume 61ae1ffb-44a7-4972-9a31-53d541d5be01 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:24 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:24 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 1073741824 Jul 07 17:36:24 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:24 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (fad66ac8-0953-4670-903c-61b141217e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c3f867-4c4a-47b8-9d79-34649a364455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674.ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" returned: 0 in 0.962s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c3f867-4c4a-47b8-9d79-34649a364455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579244351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44be09d-948c-4934-b9ee-7bf2e7d3069b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:25Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c751ae9f-b739-4e2c-bfa3-2d4ec0dc1a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c751ae9f-b739-4e2c-bfa3-2d4ec0dc1a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa718374-6894-4b0e-9014-7b993f763e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa718374-6894-4b0e-9014-7b993f763e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44be09d-948c-4934-b9ee-7bf2e7d3069b', 'volume_name': 'volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e328d494-7b6b-4590-ad56-f9d0e14916f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e328d494-7b6b-4590-ad56-f9d0e14916f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5b6143-7175-477b-931c-4291c8c07bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume b44be09d-948c-4934-b9ee-7bf2e7d3069b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b', 'volume_size': 1} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0" released by "_delete_snapshot" :: held 3.761s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-57983ed1-305a-4992-a6ad-20fe8f8ea674" released by "delete_snapshot" :: held 3.802s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['613a4cb0-6754-4644-b72f-39d9592c09f0', 'cc8f8442-4091-4e29-a4d5-79050b180e06', 'c4e62682-ebfa-42ce-8f2b-d22273defce1', 'bf48320d-bc0c-467f-9ddb-be911c38349d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Delete snapshot completed successfully. Jul 07 17:36:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5076c1fb-ae78-4bd7-b442-2b0f8cef691d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-ef54c9d5-0fd0-4f15-9be7-9313665ed5e0-delete_snapshot" released by "delete_snapshot" :: held 4.071s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (cbad8363-7c37-43a8-9baa-b009dbb179b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574c7334-0eac-4b8f-8cd5-f5f4e15318ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574c7334-0eac-4b8f-8cd5-f5f4e15318ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718283818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15640960-da6d-4dfd-b2e0-e6b459f234cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:25Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85625ce8-0a30-4a06-ab02-a223503cde56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85625ce8-0a30-4a06-ab02-a223503cde56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c2c3db-58b7-48f0-be63-bc47a4050046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c2c3db-58b7-48f0-be63-bc47a4050046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15640960-da6d-4dfd-b2e0-e6b459f234cf', 'volume_name': 'volume-15640960-da6d-4dfd-b2e0-e6b459f234cf', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402affa5-bbf7-4530-b235-fd03cdf3b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402affa5-bbf7-4530-b235-fd03cdf3b78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1394497-bb14-4e73-8610-200bbeaa363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume 15640960-da6d-4dfd-b2e0-e6b459f234cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15640960-da6d-4dfd-b2e0-e6b459f234cf', 'volume_size': 1} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-57983ed1-305a-4992-a6ad-20fe8f8ea674-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-57983ed1-305a-4992-a6ad-20fe8f8ea674-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-57983ed1-305a-4992-a6ad-20fe8f8ea674" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-57983ed1-305a-4992-a6ad-20fe8f8ea674" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bd8304-b144-4bea-a992-904fd3bd404c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:25 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 1073741824" returned: 0 in 1.286s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:25 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:25 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:25 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 Jul 07 17:36:25 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (2bd9a8e1-f305-4a49-bcb6-0f08cabb625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76921091-7274-498a-ac20-e9273726dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76921091-7274-498a-ac20-e9273726dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1112572079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c4b2d0-525d-4623-a815-98bed318a2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:26Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f61507-6be5-4841-814a-0e62dde68e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f61507-6be5-4841-814a-0e62dde68e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12090f3b-e22f-48ca-8dcf-82086fb8ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12090f3b-e22f-48ca-8dcf-82086fb8ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c4b2d0-525d-4623-a815-98bed318a2bb', 'volume_name': 'volume-e5c4b2d0-525d-4623-a815-98bed318a2bb', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3e7359-0e54-4024-b124-edd134a73e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3e7359-0e54-4024-b124-edd134a73e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8015f7e9-b171-4769-9712-a02a767d42eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:25 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume e5c4b2d0-525d-4623-a815-98bed318a2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c4b2d0-525d-4623-a815-98bed318a2bb', 'volume_size': 1} Jul 07 17:36:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (14facdeb-ad4b-4edf-8e3a-c127f00d89ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d91beb-8c60-4ca0-b420-41ad4f5c0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d91beb-8c60-4ca0-b420-41ad4f5c0fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1297459312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e1e45f-dffc-4b11-8f18-e0a5eeb4553e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:26Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91fb22a-9daa-422f-bde2-7df22d22d570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91fb22a-9daa-422f-bde2-7df22d22d570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e83b05f-c413-4135-bc72-8706a165ef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e83b05f-c413-4135-bc72-8706a165ef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e1e45f-dffc-4b11-8f18-e0a5eeb4553e', 'volume_name': 'volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805e5bd4-84be-47c9-a302-378f162ed2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805e5bd4-84be-47c9-a302-378f162ed2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974aea92-a96a-480a-b16e-cadacdd9199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume 99e1e45f-dffc-4b11-8f18-e0a5eeb4553e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e', 'volume_size': 1} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:26 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01" returned: 0 in 0.931s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579244351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44be09d-948c-4934-b9ee-7bf2e7d3069b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:25Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating volume b44be09d-948c-4934-b9ee-7bf2e7d3069b {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:26 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:26 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 1.157s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:26 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b 1073741824 Jul 07 17:36:26 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91329113-4fec-4e0b-b6cf-c1c2fd6634f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ae1ffb-44a7-4972-9a31-53d541d5be01', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065ef025-20e7-43eb-88cf-1834bcfa00dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:26 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674 Jul 07 17:36:26 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 (61ae1ffb-44a7-4972-9a31-53d541d5be01): created successfully Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065ef025-20e7-43eb-88cf-1834bcfa00dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (ccddba04-cd29-470f-8fd8-0e52bb7f9eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-33d9b3f9-801b-4262-aba3-a8da536be9a4 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created volume successfully. Jul 07 17:36:27 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-57983ed1-305a-4992-a6ad-20fe8f8ea674" returned: 0 in 0.720s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-57983ed1-305a-4992-a6ad-20fe8f8ea674" released by "delete_volume" :: held 1.962s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['233a5042-c1d6-47df-9e03-3bef89b5965c', '39d416d8-f3e2-4a4f-9122-60f107331f06', '29c17bc2-5656-4efd-b541-f312a11198ee', '69bc096c-82d5-45f4-ae4c-e1d2bb823ef4'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:27 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:27 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:27 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b 1073741824" returned: 0 in 1.004s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:27 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b Jul 07 17:36:27 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (1bdc822d-6d9a-4c1c-bd19-2a8f1af2cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358da54b-2913-4c36-9469-41a2ce2e50f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:28 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.049s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358da54b-2913-4c36-9469-41a2ce2e50f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1516235813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb74963e-b678-4eb7-841b-944932af1cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:28Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69500178-e356-4685-bd23-66c3e5199f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69500178-e356-4685-bd23-66c3e5199f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbd07d2-6dc8-4e06-8956-aa68f406f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbd07d2-6dc8-4e06-8956-aa68f406f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb74963e-b678-4eb7-841b-944932af1cb5', 'volume_name': 'volume-cb74963e-b678-4eb7-841b-944932af1cb5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e046aee-f349-43b0-8f07-1586f99c82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e046aee-f349-43b0-8f07-1586f99c82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2160ca-1d05-41b2-be1f-a162ad27bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:28 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Volume cb74963e-b678-4eb7-841b-944932af1cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb74963e-b678-4eb7-841b-944932af1cb5', 'volume_size': 1} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Deleted volume successfully. Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ad254030-bf0d-45ac-8dd3-0e1748274753 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-57983ed1-305a-4992-a6ad-20fe8f8ea674-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:28 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b" returned: 0 in 1.119s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718283818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15640960-da6d-4dfd-b2e0-e6b459f234cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:25Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating volume 15640960-da6d-4dfd-b2e0-e6b459f234cf {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:28 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:28 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf 1073741824 Jul 07 17:36:28 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5b6143-7175-477b-931c-4291c8c07bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b75c077d-9650-4116-afee-81978dcb0ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:28 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b (b44be09d-948c-4934-b9ee-7bf2e7d3069b): created successfully Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b75c077d-9650-4116-afee-81978dcb0ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (fad66ac8-0953-4670-903c-61b141217e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-125ef243-5e96-4ec5-a68c-92c8811339db tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created volume successfully. Jul 07 17:36:29 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf 1073741824" returned: 0 in 0.911s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:29 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf Jul 07 17:36:29 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:30 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf" returned: 0 in 0.667s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.622s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1112572079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c4b2d0-525d-4623-a815-98bed318a2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:26Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating volume e5c4b2d0-525d-4623-a815-98bed318a2bb {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:30 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1394497-bb14-4e73-8610-200bbeaa363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15640960-da6d-4dfd-b2e0-e6b459f234cf', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:30 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb 1073741824 Jul 07 17:36:30 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951c5f0e-f9b0-41dc-b2d8-bc443dfeb649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume volume-15640960-da6d-4dfd-b2e0-e6b459f234cf (15640960-da6d-4dfd-b2e0-e6b459f234cf): created successfully Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951c5f0e-f9b0-41dc-b2d8-bc443dfeb649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (cbad8363-7c37-43a8-9baa-b009dbb179b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:30 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-85ce0793-2b95-4c03-ab74-bd2d70e3a156 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created volume successfully. Jul 07 17:36:31 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb 1073741824" returned: 0 in 0.949s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:31 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb Jul 07 17:36:31 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:32 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb" returned: 0 in 0.707s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.783s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1297459312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e1e45f-dffc-4b11-8f18-e0a5eeb4553e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129e5c52d3db4264894038d790256e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:26Z,use_quota=True,user_id='0f64f5636fb640f3b1023784dcac281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Creating volume 99e1e45f-dffc-4b11-8f18-e0a5eeb4553e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:32 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8015f7e9-b171-4769-9712-a02a767d42eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c4b2d0-525d-4623-a815-98bed318a2bb', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:32 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e 1073741824 Jul 07 17:36:32 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c4f053-c971-4893-b07d-22eb8662ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:32 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume volume-e5c4b2d0-525d-4623-a815-98bed318a2bb (e5c4b2d0-525d-4623-a815-98bed318a2bb): created successfully Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c4f053-c971-4893-b07d-22eb8662ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (2bd9a8e1-f305-4a49-bcb6-0f08cabb625c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d7735bd9-0205-4b4c-b07a-ccfc60758b91 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created volume successfully. Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:32 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:32 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:33 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e 1073741824" returned: 0 in 0.972s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:33 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e Jul 07 17:36:33 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:33 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.763s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:36:33 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e" returned: 0 in 0.682s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.195s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1516235813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb74963e-b678-4eb7-841b-944932af1cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:28Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Creating volume cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:33 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:33 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 1073741824 Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974aea92-a96a-480a-b16e-cadacdd9199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:33 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a16683-cd7e-4f37-a203-d0341d857730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:33 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Volume volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e (99e1e45f-dffc-4b11-8f18-e0a5eeb4553e): created successfully Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a16683-cd7e-4f37-a203-d0341d857730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Flow 'volume_create_manager' (14facdeb-ad4b-4edf-8e3a-c127f00d89ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-06f303b9-c55d-4c64-98ff-8c2113f106d3 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created volume successfully. Jul 07 17:36:34 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 1073741824" returned: 0 in 1.120s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:35 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:36:35 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce583044-af37-4743-8261-ea0aec0acdc2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:35 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e Jul 07 17:36:35 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:35 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2160ca-1d05-41b2-be1f-a162ad27bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb74963e-b678-4eb7-841b-944932af1cb5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d162ca8-5037-4d5f-95b2-6b342dcacd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:35 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Volume volume-cb74963e-b678-4eb7-841b-944932af1cb5 (cb74963e-b678-4eb7-841b-944932af1cb5): created successfully Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d162ca8-5037-4d5f-95b2-6b342dcacd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (1bdc822d-6d9a-4c1c-bd19-2a8f1af2cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7ce7e663-937d-4cfc-87b0-d82977ab4ae0 tempest-VolumesSnapshotTestJSON-218485035 None] Created volume successfully. Jul 07 17:36:36 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e" returned: 0 in 0.825s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:36 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e Jul 07 17:36:36 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:36 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e" returned: 0 in 0.690s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e" released by "delete_volume" :: held 1.556s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:36 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['3166a121-c07e-43a8-988b-9f74a9092787', '4f9fff08-ad05-4546-b288-0dc9501b5067', 'f29624c7-1709-42ea-9354-f820500cb037', 'b59e779f-9f86-48a2-b895-4ba9431302ee'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:37 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:37 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Creating offline snapshot e3ddcfb0-24c8-4f34-804c-4654315a1b02 of volume cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[36913be2-4865-40f3-a9bc-58bb8e50e449]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:37 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:36:37 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-e5c4b2d0-525d-4623-a815-98bed318a2bb-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-e5c4b2d0-525d-4623-a815-98bed318a2bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-e5c4b2d0-525d-4623-a815-98bed318a2bb" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-e5c4b2d0-525d-4623-a815-98bed318a2bb" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[739816e1-40a2-44aa-9b34-4f7cbaeb7867]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:37 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb Jul 07 17:36:37 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:37 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.720s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleted volume successfully. Jul 07 17:36:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cfc492bd-bdc8-41ae-bcb7-5e9576155c6f tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-99e1e45f-dffc-4b11-8f18-e0a5eeb4553e-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:38 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 0.933s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:38 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 1G Jul 07 17:36:38 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:38 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb" returned: 0 in 0.894s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:38 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb Jul 07 17:36:38 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:38 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 1G" returned: 0 in 0.893s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb74963e-b678-4eb7-841b-944932af1cb5 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:39 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb74963e-b678-4eb7-841b-944932af1cb5 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 Jul 07 17:36:39 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:39 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e5c4b2d0-525d-4623-a815-98bed318a2bb" returned: 0 in 0.829s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-e5c4b2d0-525d-4623-a815-98bed318a2bb" released by "delete_volume" :: held 1.781s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['16486d48-866a-4ead-93ac-c19aae3a0fc6', '54a9bd05-82d1-4670-9cc9-9ca0e11f09ee', 'b087e3b1-a5e6-4dd1-a28f-860efa792728', '916ac4bf-9cdf-4762-9e6f-2d56caa6c157'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:39 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:39 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-15640960-da6d-4dfd-b2e0-e6b459f234cf-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-15640960-da6d-4dfd-b2e0-e6b459f234cf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-15640960-da6d-4dfd-b2e0-e6b459f234cf" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-15640960-da6d-4dfd-b2e0-e6b459f234cf" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664e57c-2402-40a4-8b7a-1ed5aa7087dc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:40 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb74963e-b678-4eb7-841b-944932af1cb5 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02" returned: 0 in 1.112s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:40 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 is being set with open permissions: ugo+rw Jul 07 17:36:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:40 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf Jul 07 17:36:40 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:40 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 Jul 07 17:36:40 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:40 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.055s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:40 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:40 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleted volume successfully. Jul 07 17:36:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-652fb6f9-7afb-419c-a4aa-5f9eb13f5388 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-e5c4b2d0-525d-4623-a815-98bed318a2bb-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:41 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf" returned: 0 in 1.039s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:41 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf Jul 07 17:36:41 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:41 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02" returned: 0 in 1.127s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:41 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info Jul 07 17:36:41 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:41 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-15640960-da6d-4dfd-b2e0-e6b459f234cf" returned: 0 in 0.692s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-15640960-da6d-4dfd-b2e0-e6b459f234cf" released by "delete_volume" :: held 1.797s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=82,cinder:UPDATE=111,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=124,cinder:UPDATE=107,cinder:DELETE=10,cinder:INSERT=23 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['05676da5-52a9-485a-b6e5-a8842134df7e', '52bd1317-1b5e-4492-a908-e1bfd615a0dd', '820ab7b3-ce6a-4c15-9b32-3be5e944b8d7', '8591910f-99cc-493a-9379-0b8f99b0cd29'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:41 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:41 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-b44be09d-948c-4934-b9ee-7bf2e7d3069b-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:42 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info" returned: 0 in 0.860s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:42 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info is being set with open permissions: ugo+rw Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-b44be09d-948c-4934-b9ee-7bf2e7d3069b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:42 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info Jul 07 17:36:42 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-b44be09d-948c-4934-b9ee-7bf2e7d3069b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-b44be09d-948c-4934-b9ee-7bf2e7d3069b" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf957b5c-34c7-4d38-8dd0-bd715d0eda5b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:42 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b Jul 07 17:36:42 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:42 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.918s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleted volume successfully. Jul 07 17:36:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d9427503-a9c8-45b2-bd02-42f516f5dbf1 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-15640960-da6d-4dfd-b2e0-e6b459f234cf-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:43 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.info" returned: 0 in 1.099s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.155s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-29922909-e16a-4e0f-95be-cdf8e241652d tempest-VolumesSnapshotTestJSON-218485035 None] Create snapshot completed successfully Jul 07 17:36:43 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b" returned: 0 in 1.069s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:43 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b Jul 07 17:36:43 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:44 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b44be09d-948c-4934-b9ee-7bf2e7d3069b" returned: 0 in 0.701s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-b44be09d-948c-4934-b9ee-7bf2e7d3069b" released by "delete_volume" :: held 1.846s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['1c907463-1828-4283-931a-ca4d724a1d99', '45ba0ba9-a6fb-4743-a921-32271e6cd4d6', '016c17f1-c15c-4ea7-99fa-01ed829c5a91', '367ff716-f25b-48b5-97f2-2b0e9f70fae3'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:44 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:44 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-61ae1ffb-44a7-4972-9a31-53d541d5be01-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-61ae1ffb-44a7-4972-9a31-53d541d5be01-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-61ae1ffb-44a7-4972-9a31-53d541d5be01" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-61ae1ffb-44a7-4972-9a31-53d541d5be01" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90735eb-80bf-4dce-b1d5-a111891e505b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:44 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 Jul 07 17:36:44 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:45 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.846s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:45 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleted volume successfully. Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cafc1572-bc10-4987-a95e-121eed10eb60 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-b44be09d-948c-4934-b9ee-7bf2e7d3069b-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (9119182c-9b12-4a94-bff3-a44477606340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fba1e65-0678-4b61-9bf2-ba67ace818a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fba1e65-0678-4b61-9bf2-ba67ace818a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711543900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0442d19-c125-48c5-899c-6ed79a46e53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec3a2249094f9e800091b75ab67391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3ddcfb0-24c8-4f34-804c-4654315a1b02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:45Z,use_quota=True,user_id='6ff93ddfa10e4af593221e9e74d04846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df80942e-6fbf-4fca-8af0-5a52f7696643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df80942e-6fbf-4fca-8af0-5a52f7696643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12b8599-dff6-40be-a8ba-1a9489133605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12b8599-dff6-40be-a8ba-1a9489133605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0442d19-c125-48c5-899c-6ed79a46e53b', 'volume_name': 'volume-d0442d19-c125-48c5-899c-6ed79a46e53b', 'volume_size': 1, 'snapshot_id': 'e3ddcfb0-24c8-4f34-804c-4654315a1b02'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9ecced-ebbb-4dc8-b554-c09af25861fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9ecced-ebbb-4dc8-b554-c09af25861fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72dfd871-cfb1-4e97-9891-8f121f0b62d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Volume d0442d19-c125-48c5-899c-6ed79a46e53b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0442d19-c125-48c5-899c-6ed79a46e53b', 'volume_size': 1, 'snapshot_id': 'e3ddcfb0-24c8-4f34-804c-4654315a1b02'} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-e3ddcfb0-24c8-4f34-804c-4654315a1b02-d0442d19-c125-48c5-899c-6ed79a46e53b" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-e3ddcfb0-24c8-4f34-804c-4654315a1b02-d0442d19-c125-48c5-899c-6ed79a46e53b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Creating volume d0442d19-c125-48c5-899c-6ed79a46e53b from snapshot e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-d0442d19-c125-48c5-899c-6ed79a46e53b" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-d0442d19-c125-48c5-899c-6ed79a46e53b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] snapshot: e3ddcfb0-24c8-4f34-804c-4654315a1b02, volume: d0442d19-c125-48c5-899c-6ed79a46e53b, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[02324928-5226-486a-96db-a0b372ca5a44]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:45 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 Jul 07 17:36:45 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:45 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01" returned: 0 in 0.975s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:45 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01 Jul 07 17:36:45 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:46 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02" returned: 0 in 0.936s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb74963e-b678-4eb7-841b-944932af1cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e367a18-fb65-4ba7-a34a-60c5131ccd4e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:46 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-61ae1ffb-44a7-4972-9a31-53d541d5be01" returned: 0 in 0.877s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:46 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:36:46 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-61ae1ffb-44a7-4972-9a31-53d541d5be01" released by "delete_volume" :: held 1.915s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['e6925b9d-726d-4838-9f29-9076a1f615c2', 'f0bfd9e9-d2cf-47e3-b346-af3e0ceb4475', '5b6e44c5-4813-496e-9425-b0fd7d32c3cd', '0f374f06-92e4-45c5-80c1-ac4068dc2152'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:46 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:46 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-596ba433-6887-47d3-91e2-e77d20ce67f3-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-596ba433-6887-47d3-91e2-e77d20ce67f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-6c44f33d-6d48-46a8-8d62-2f21e53d193f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-6c44f33d-6d48-46a8-8d62-2f21e53d193f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-596ba433-6887-47d3-91e2-e77d20ce67f3" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-596ba433-6887-47d3-91e2-e77d20ce67f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleting offline snapshot 596ba433-6887-47d3-91e2-e77d20ce67f3 of volume 6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] snapshot_file for this snap is: volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df89244-cffe-4c05-ab16-6c97d1107e47]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:47 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 Jul 07 17:36:47 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:47 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 0.984s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:47 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b Jul 07 17:36:47 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:47 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.859s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleted volume successfully. Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-896989d9-6a7d-43b6-97b0-6e6120f81acf tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-61ae1ffb-44a7-4972-9a31-53d541d5be01-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:47 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3" returned: 0 in 0.952s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6c510-69df-40f1-afba-b2f12613ee7d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:48 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f Jul 07 17:36:48 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:49 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f" returned: 0 in 1.774s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:49 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 Jul 07 17:36:49 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:52 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3" returned: 0 in 2.649s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:52 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3 Jul 07 17:36:52 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:52 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b" returned: 0 in 5.499s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:52 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee6bff9-b35d-4957-812a-1eacf767fde5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:53 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:36:53 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:53 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f.596ba433-6887-47d3-91e2-e77d20ce67f3" returned: 0 in 0.978s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-596ba433-6887-47d3-91e2-e77d20ce67f3" released by "_delete_snapshot" :: held 6.558s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-6c44f33d-6d48-46a8-8d62-2f21e53d193f" released by "delete_snapshot" :: held 6.589s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['bf9d3328-3fc0-4720-aeed-01ce6ccc339b', '7f2ce93a-f3ee-4ab2-bb08-d509b40fe391', 'ef31ede6-445b-46ad-a5e5-020616cb86f1', 'a6389e0f-a3e2-486a-9fca-c264a61dc350'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Flow 'volume_create_manager' (1cf2c4cc-d5e4-41fc-8f16-1f08a77c580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36599217-3aae-4719-904e-4a5e14040327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Delete snapshot completed successfully. Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36599217-3aae-4719-904e-4a5e14040327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-875055531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa81dc74b7648369f70ad63f4ed818a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:54Z,use_quota=True,user_id='8a4e3983c62d401f9ab8d729791e98e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73de109a-0698-4d40-b5d8-b174ca252a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73de109a-0698-4d40-b5d8-b174ca252a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6caff4a8-5585-40f3-850f-37aecbd87579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-649bcd43-1069-496a-867d-cbe2699f6900 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-596ba433-6887-47d3-91e2-e77d20ce67f3-delete_snapshot" released by "delete_snapshot" :: held 6.820s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6caff4a8-5585-40f3-850f-37aecbd87579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547', 'volume_name': 'volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc996f9d-eb01-405d-81a6-16e3e19d04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:53 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc996f9d-eb01-405d-81a6-16e3e19d04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c66d15b-c601-4b1c-ba57-a11998472094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:53 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Volume ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Trying to clone ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 1.051s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:36:53 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Converted 1024.00 MB image at 186.17 MB/s Jul 07 17:36:53 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b is being set with open permissions: ugo+rw Jul 07 17:36:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:53 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b Jul 07 17:36:53 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:36:54 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca5b75b-6a8f-43d3-b9c6-9d104c2e86e4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-6c44f33d-6d48-46a8-8d62-2f21e53d193f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:54 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD Jul 07 17:36:54 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-6c44f33d-6d48-46a8-8d62-2f21e53d193f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "cinder-quobyte-6c44f33d-6d48-46a8-8d62-2f21e53d193f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-6c44f33d-6d48-46a8-8d62-2f21e53d193f" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de61d0-e896-425d-a791-400e82407548]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:54 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b" returned: 0 in 0.759s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-d0442d19-c125-48c5-899c-6ed79a46e53b" released by "_copy_volume_from_snapshot" :: held 9.353s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-e3ddcfb0-24c8-4f34-804c-4654315a1b02-d0442d19-c125-48c5-899c-6ed79a46e53b" released by "_create_volume_from_snapshot" :: held 9.384s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.400s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:54 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f Jul 07 17:36:54 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72dfd871-cfb1-4e97-9891-8f121f0b62d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0442d19-c125-48c5-899c-6ed79a46e53b', 'volume_size': 1, 'snapshot_id': 'e3ddcfb0-24c8-4f34-804c-4654315a1b02'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d13387-3622-45ba-885f-7fe2115c3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:54 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Volume volume-d0442d19-c125-48c5-899c-6ed79a46e53b (d0442d19-c125-48c5-899c-6ed79a46e53b): created successfully Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d13387-3622-45ba-885f-7fe2115c3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Flow 'volume_create_manager' (9119182c-9b12-4a94-bff3-a44477606340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:54 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b2f39f6f-c1a2-4c36-b8d5-ca0602ce8c22 tempest-VolumesSnapshotTestJSON-218485035 None] Created volume successfully. Jul 07 17:36:55 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 is fetched for user 8a4e3983c62d401f9ab8d729791e98e0. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c440ec-f6f8-4e5e-8ef7-c38586437a3c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:55 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD Jul 07 17:36:55 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-d0442d19-c125-48c5-899c-6ed79a46e53b-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-d0442d19-c125-48c5-899c-6ed79a46e53b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:55 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f" returned: 0 in 0.851s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:55 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f Jul 07 17:36:55 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-d0442d19-c125-48c5-899c-6ed79a46e53b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-d0442d19-c125-48c5-899c-6ed79a46e53b" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdea5292-3e93-4b4b-acc2-0dc62377a669]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:55 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b Jul 07 17:36:55 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:56 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-875055531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa81dc74b7648369f70ad63f4ed818a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:54Z,use_quota=True,user_id='8a4e3983c62d401f9ab8d729791e98e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Creating volume ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:56 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:56 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 1073741824 Jul 07 17:36:56 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:56 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c44f33d-6d48-46a8-8d62-2f21e53d193f" returned: 0 in 0.726s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-quobyte-6c44f33d-6d48-46a8-8d62-2f21e53d193f" released by "delete_volume" :: held 1.644s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Created reservations ['7a7d37d2-95b1-4344-869c-747d878cc33a', '5e4963c4-340d-4065-ab3c-b272106d0c11', '5bdc510f-66a0-4207-9504-41a39c430b58', '801a035c-0661-4ac7-81d6-37cbcbb40b07'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:56 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:56 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:56 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b" returned: 0 in 0.818s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:56 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b Jul 07 17:36:56 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:57 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 1073741824" returned: 0 in 0.994s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:57 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:36:57 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:57 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.787s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Deleted volume successfully. Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7df731e5-43e2-4830-9712-392074c3f569 tempest-CreateVolumesFromSnapshotTest-1271114434 None] Lock "cinder-6c44f33d-6d48-46a8-8d62-2f21e53d193f-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:57 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0442d19-c125-48c5-899c-6ed79a46e53b" returned: 0 in 0.819s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-d0442d19-c125-48c5-899c-6ed79a46e53b" released by "delete_volume" :: held 1.698s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['4ae4df34-4862-4fc7-b94d-44be1dcc4a19', '7cf98d08-d841-4c8d-bbd5-004aa53b5f89', '2fccbba6-9717-4690-af49-04600575abbd', 'a5b3cf8f-0f96-45fe-9da3-22d5b1b78622'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:57 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:36:57 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:57 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 0.873s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:57 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Attempting download of 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-e3ddcfb0-24c8-4f34-804c-4654315a1b02-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-e3ddcfb0-24c8-4f34-804c-4654315a1b02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-cb74963e-b678-4eb7-841b-944932af1cb5" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-cb74963e-b678-4eb7-841b-944932af1cb5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-e3ddcfb0-24c8-4f34-804c-4654315a1b02" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046b452-d330-40cb-b08b-21792256d58e]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-e3ddcfb0-24c8-4f34-804c-4654315a1b02" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Deleting offline snapshot e3ddcfb0-24c8-4f34-804c-4654315a1b02 of volume cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] snapshot_file for this snap is: volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:36:58 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.757s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Deleted volume successfully. Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b8862-3ff3-4a8b-b6ce-cc373c11d547]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-feeead78-8391-4c8a-8cd6-11dbbd1ed3db tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-d0442d19-c125-48c5-899c-6ed79a46e53b-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:58 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t Jul 07 17:36:58 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:58 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 Jul 07 17:36:58 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:58 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t" returned: 0 in 0.787s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:58 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t Jul 07 17:36:58 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:59 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02" returned: 0 in 0.925s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb74963e-b678-4eb7-841b-944932af1cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d1c8f-a187-465d-a053-1587446ca907]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:59 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:36:59 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:59 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t" returned: 1 in 0.804s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_alpi713t' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd62d8-48c6-4012-b5bb-611aaad58fa0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:59 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD Jul 07 17:36:59 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:59 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 0.802s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:59 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 Jul 07 17:36:59 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Flow 'volume_create_manager' (f85d7270-6d7c-4fd1-aa09-55b359456373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720b50c9-f8a9-42c6-8a8f-cc51d64b707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720b50c9-f8a9-42c6-8a8f-cc51d64b707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058664932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39308b8f-8e0b-444d-a744-5c6cabc33d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5454716fde444c8c8cd2e1aed7ba9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:00Z,use_quota=True,user_id='93992e8c00674b9394b37635d84867f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c257a1b-8124-42bb-928f-280c209d4885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c257a1b-8124-42bb-928f-280c209d4885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d2c203-2eb8-4dea-8cf2-829c55d0f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d2c203-2eb8-4dea-8cf2-829c55d0f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39308b8f-8e0b-444d-a744-5c6cabc33d82', 'volume_name': 'volume-39308b8f-8e0b-444d-a744-5c6cabc33d82', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76027f44-1729-48b1-b016-c7f0078e33d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76027f44-1729-48b1-b016-c7f0078e33d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dbc7bd-c561-47bb-8ca4-c83d63cbaf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Volume 39308b8f-8e0b-444d-a744-5c6cabc33d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39308b8f-8e0b-444d-a744-5c6cabc33d82', 'volume_size': 1} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058664932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39308b8f-8e0b-444d-a744-5c6cabc33d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5454716fde444c8c8cd2e1aed7ba9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:00Z,use_quota=True,user_id='93992e8c00674b9394b37635d84867f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Creating volume 39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:00 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 1073741824 Jul 07 17:37:00 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:00 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 was qcow2, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:00 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:37:00 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:00 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02" returned: 0 in 0.788s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:00 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02 Jul 07 17:37:00 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:01 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 1073741824" returned: 0 in 0.939s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:01 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:01 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:01 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5.e3ddcfb0-24c8-4f34-804c-4654315a1b02" returned: 0 in 0.743s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-e3ddcfb0-24c8-4f34-804c-4654315a1b02" released by "_delete_snapshot" :: held 3.430s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-cb74963e-b678-4eb7-841b-944932af1cb5" released by "delete_snapshot" :: held 3.471s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['c711bf36-387f-4d03-a589-49a20ed5940e', '574a4f11-d756-45b8-b969-77488f5b7d7c', 'ebd302e8-2b88-4c06-a6bd-a8c85693b8f2', 'e7aa7b1a-9a61-405f-86df-f080287a1267'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Delete snapshot completed successfully. Jul 07 17:37:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-73b4abae-10fc-490d-b4a6-3fc68fa08173 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-e3ddcfb0-24c8-4f34-804c-4654315a1b02-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:02 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 0.748s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dbc7bd-c561-47bb-8ca4-c83d63cbaf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39308b8f-8e0b-444d-a744-5c6cabc33d82', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0d4c4f-26ee-4a89-9a4f-93fc729336a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Volume volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 (39308b8f-8e0b-444d-a744-5c6cabc33d82): created successfully Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0d4c4f-26ee-4a89-9a4f-93fc729336a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Flow 'volume_create_manager' (f85d7270-6d7c-4fd1-aa09-55b359456373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ad135d1c-dbaf-4a12-970c-7ed9db18d587 tempest-VolumeDependencyTests-1938138273 None] Created volume successfully. Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-cb74963e-b678-4eb7-841b-944932af1cb5-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-cb74963e-b678-4eb7-841b-944932af1cb5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-cb74963e-b678-4eb7-841b-944932af1cb5" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-cb74963e-b678-4eb7-841b-944932af1cb5" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf3e4ae-3aad-4597-8a17-481483c2786a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Creating offline snapshot 377849e5-4fb4-439a-a6af-4ac5cfc90a14 of volume 39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bf1b6b-33fc-4416-8229-a3fb925c4524]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:02 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:37:02 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:02 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:02 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:03 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 2.524s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1_9fgz986kdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:37:03 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Converted 112.00 MB image at 44.36 MB/s Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:03 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 1G Jul 07 17:37:03 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:03 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 0.851s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:03 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5 Jul 07 17:37:03 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:03 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 0.949s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:03 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 1G Jul 07 17:37:03 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:03 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 1G" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e0bc3b-89fa-4009-bd9a-d83ba15b7791]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:04 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:37:04 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:04 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-cb74963e-b678-4eb7-841b-944932af1cb5" returned: 0 in 0.714s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-cb74963e-b678-4eb7-841b-944932af1cb5" released by "delete_volume" :: held 1.687s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['bbcb44f4-d5c4-4f6e-b3bf-9d5293723823', 'f2beb501-065f-4ac4-a781-a5beb90eee1a', '85106b9e-04a4-4d93-a1b7-b21a6d8a5ae3', 'aa43e331-fa3e-458e-8207-0be425166561'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:04 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:04 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:04 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 1G" returned: 0 in 0.928s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:04 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 Jul 07 17:37:04 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-b6b8f70e-326d-4475-9dc0-5011199f95ad-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-b6b8f70e-326d-4475-9dc0-5011199f95ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "cinder-quobyte-b6b8f70e-326d-4475-9dc0-5011199f95ad" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:04 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 0.911s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-b6b8f70e-326d-4475-9dc0-5011199f95ad" acquired by "delete_volume" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4b9af0-1e29-4421-a1f6-a9f4ebdf753b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:04 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:37:04 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:05 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad Jul 07 17:37:05 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:05 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.769s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Deleted volume successfully. Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e1ebc6b2-a52d-440b-ae1f-825e2ed165ee tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-cb74963e-b678-4eb7-841b-944932af1cb5-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:05 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14" returned: 0 in 0.829s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:05 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 is being set with open permissions: ugo+rw Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:05 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 Jul 07 17:37:05 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:05 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 1 in 0.907s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Downloaded image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}])) to volume ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Temporary image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 for user 8a4e3983c62d401f9ab8d729791e98e0 is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Marking volume ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:37:05 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad" returned: 0 in 0.869s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Copying metadata from image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 to ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Creating volume glance metadata for volume ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 backed by image 9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:37:05 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad Jul 07 17:37:05 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c66d15b-c601-4b1c-ba57-a11998472094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547', 'volume_size': 1, 'image_id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fcf9f068cab4ddbad3bfe74aa498260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1', 'created_at': datetime.datetime(2026, 7, 7, 15, 15, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 15, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9687f2f4-76b7-4f0b-aa3f-68e5eafa7de1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e0045b-2d47-4552-9959-a9c6bfc65d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:05 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Volume volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 (ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547): created successfully Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e0045b-2d47-4552-9959-a9c6bfc65d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Flow 'volume_create_manager' (1cf2c4cc-d5e4-41fc-8f16-1f08a77c580a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-03036d8f-4216-46ef-ae52-aae7d3914dbb tempest-TestShelveInstance-1790340110 None] Created volume successfully. Jul 07 17:37:06 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14" returned: 0 in 0.670s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:06 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info Jul 07 17:37:06 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:06 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b6b8f70e-326d-4475-9dc0-5011199f95ad" returned: 0 in 0.723s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-quobyte-b6b8f70e-326d-4475-9dc0-5011199f95ad" released by "delete_volume" :: held 1.656s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Created reservations ['8a4e738d-0efd-4628-9010-8bbcbc70138f', 'a31c934c-ccea-42db-8ea9-32a2e227a146', 'cf46c369-a691-49a1-b2ab-3cc300c015af', '14d56776-9824-4466-97d1-92425831b686'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:06 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:06 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:06 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info" returned: 0 in 0.675s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:06 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info is being set with open permissions: ugo+rw Jul 07 17:37:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:06 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info Jul 07 17:37:06 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:07 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.717s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:07 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Deleted volume successfully. Jul 07 17:37:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-12339df1-b39e-4449-8e3f-ae973e4a7310 tempest-VolumesSnapshotTestJSON-218485035 None] Lock "cinder-b6b8f70e-326d-4475-9dc0-5011199f95ad-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:07 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.info" returned: 0 in 0.756s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.924s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3bfa8014-4782-4f73-8e52-dfea82579d43 tempest-VolumeDependencyTests-1938138273 None] Create snapshot completed successfully Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Flow 'volume_create_manager' (b729d1ec-76b9-43f8-9e04-3f9f604073e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6d04c5-03c9-45f5-99c1-cde208b2e5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6d04c5-03c9-45f5-99c1-cde208b2e5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123925561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071534ca-9f82-4c09-b575-49317f0792eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5454716fde444c8c8cd2e1aed7ba9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=377849e5-4fb4-439a-a6af-4ac5cfc90a14,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:08Z,use_quota=True,user_id='93992e8c00674b9394b37635d84867f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e184ffe-d4af-42fc-a121-12b62ead5b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e184ffe-d4af-42fc-a121-12b62ead5b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4393cb7e-e732-4e33-8efb-20a39c03cafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4393cb7e-e732-4e33-8efb-20a39c03cafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '071534ca-9f82-4c09-b575-49317f0792eb', 'volume_name': 'volume-071534ca-9f82-4c09-b575-49317f0792eb', 'volume_size': 1, 'snapshot_id': '377849e5-4fb4-439a-a6af-4ac5cfc90a14'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ba6c2-3e2f-4022-aa32-d667a75d461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592ba6c2-3e2f-4022-aa32-d667a75d461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac5228-ba0f-41d6-821c-a9fa84e90c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Volume 071534ca-9f82-4c09-b575-49317f0792eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-071534ca-9f82-4c09-b575-49317f0792eb', 'volume_size': 1, 'snapshot_id': '377849e5-4fb4-439a-a6af-4ac5cfc90a14'} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-quobyte-377849e5-4fb4-439a-a6af-4ac5cfc90a14-071534ca-9f82-4c09-b575-49317f0792eb" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-377849e5-4fb4-439a-a6af-4ac5cfc90a14-071534ca-9f82-4c09-b575-49317f0792eb" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Creating volume 071534ca-9f82-4c09-b575-49317f0792eb from snapshot 377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-quobyte-071534ca-9f82-4c09-b575-49317f0792eb" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-071534ca-9f82-4c09-b575-49317f0792eb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] snapshot: 377849e5-4fb4-439a-a6af-4ac5cfc90a14, volume: 071534ca-9f82-4c09-b575-49317f0792eb, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[85658d65-4c6e-4650-91b0-1dbf34bf26e6]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:08 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 Jul 07 17:37:08 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:09 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14" returned: 0 in 0.893s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39308b8f-8e0b-444d-a744-5c6cabc33d82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:37:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:37:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:37:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd9febb-334f-40e1-8cf0-5e97a3ab1415]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:09 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:09 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:10 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 0.939s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:10 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:37:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:10 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb Jul 07 17:37:10 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:16 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb" returned: 0 in 5.913s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c68cea-50f9-427a-b31a-38b942dbffdf]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:16 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:16 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Flow 'volume_create_manager' (357f37ca-a26e-4ef6-8ec7-3ddaf368a0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee98eb5-4db0-4774-a331-a8371966926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee98eb5-4db0-4774-a331-a8371966926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-228673833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f85798f-36f8-4308-8ed5-28eab445b70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b983564145a74c6c9a10b248de3e4303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:17Z,use_quota=True,user_id='c702cdb01c64403bb96d73d4ac587dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959fac10-2341-461a-8cdb-a5b70c9259fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959fac10-2341-461a-8cdb-a5b70c9259fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166773e5-dd20-4063-986d-c4b538da2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166773e5-dd20-4063-986d-c4b538da2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f85798f-36f8-4308-8ed5-28eab445b70f', 'volume_name': 'volume-8f85798f-36f8-4308-8ed5-28eab445b70f', 'volume_size': 2}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca0f1ef-2e68-49f8-b375-9dc23aaa33c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca0f1ef-2e68-49f8-b375-9dc23aaa33c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ad1ecd-9871-4ca6-98f9-9e585a420c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Volume 8f85798f-36f8-4308-8ed5-28eab445b70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f85798f-36f8-4308-8ed5-28eab445b70f', 'volume_size': 2} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:17 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 1.097s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:37:17 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Converted 1024.00 MB image at 173.14 MB/s Jul 07 17:37:17 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb is being set with open permissions: ugo+rw Jul 07 17:37:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:17 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb Jul 07 17:37:17 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:18 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb" returned: 0 in 0.661s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-071534ca-9f82-4c09-b575-49317f0792eb" released by "_copy_volume_from_snapshot" :: held 9.655s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-377849e5-4fb4-439a-a6af-4ac5cfc90a14-071534ca-9f82-4c09-b575-49317f0792eb" released by "_create_volume_from_snapshot" :: held 9.685s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.701s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.793s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac5228-ba0f-41d6-821c-a9fa84e90c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071534ca-9f82-4c09-b575-49317f0792eb', 'volume_size': 1, 'snapshot_id': '377849e5-4fb4-439a-a6af-4ac5cfc90a14'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af39c303-6ae9-4297-ac84-c261c51c595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec8007-98d4-4767-9946-dfc7cf425410]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:18 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Volume volume-071534ca-9f82-4c09-b575-49317f0792eb (071534ca-9f82-4c09-b575-49317f0792eb): created successfully Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af39c303-6ae9-4297-ac84-c261c51c595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:18 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Flow 'volume_create_manager' (b729d1ec-76b9-43f8-9e04-3f9f604073e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6b39d257-d8c1-4589-96f4-1f6e8f3060b7 tempest-VolumeDependencyTests-1938138273 None] Created volume successfully. Jul 07 17:37:18 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:37:18 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:19 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 0.750s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:19 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:37:19 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-377849e5-4fb4-439a-a6af-4ac5cfc90a14-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-377849e5-4fb4-439a-a6af-4ac5cfc90a14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-quobyte-39308b8f-8e0b-444d-a744-5c6cabc33d82" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-39308b8f-8e0b-444d-a744-5c6cabc33d82" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-quobyte-377849e5-4fb4-439a-a6af-4ac5cfc90a14" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-377849e5-4fb4-439a-a6af-4ac5cfc90a14" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Deleting offline snapshot 377849e5-4fb4-439a-a6af-4ac5cfc90a14 of volume 39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] snapshot_file for this snap is: volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb69fb2-746a-488e-8cf3-96a30d7e15d0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:19 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 Jul 07 17:37:19 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:19 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 1 in 0.766s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.567s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.425s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-228673833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f85798f-36f8-4308-8ed5-28eab445b70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b983564145a74c6c9a10b248de3e4303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:17Z,use_quota=True,user_id='c702cdb01c64403bb96d73d4ac587dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Creating volume 8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:19 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f 2147483648 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:19 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f 2147483648 Jul 07 17:37:19 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcdc59f6-c711-409e-a851-6352fd6982ee', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:37:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-fa63fc91-4e20-4722-be14-23805e197fde req-92d1e807-ac66-48ea-b560-fbfa64401ccf tempest-TestShelveInstance-1790340110 None] attachment_update completed successfully. Jul 07 17:37:20 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39308b8f-8e0b-444d-a744-5c6cabc33d82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:37:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ddf7b-947a-4efb-a1d0-2218083c4087]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:20 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:20 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:20 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f 2147483648" returned: 0 in 1.075s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:21 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f Jul 07 17:37:21 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:21 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 0.919s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:21 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 Jul 07 17:37:21 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:21 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f" returned: 0 in 0.658s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ad1ecd-9871-4ca6-98f9-9e585a420c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f85798f-36f8-4308-8ed5-28eab445b70f', 'volume_size': 2}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734abdf0-6815-4535-8ab5-d1e00a7daae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:21 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Volume volume-8f85798f-36f8-4308-8ed5-28eab445b70f (8f85798f-36f8-4308-8ed5-28eab445b70f): created successfully Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734abdf0-6815-4535-8ab5-d1e00a7daae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Flow 'volume_create_manager' (357f37ca-a26e-4ef6-8ec7-3ddaf368a0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-afe63f1d-95b2-451a-acd8-18570ad157a1 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Created volume successfully. Jul 07 17:37:22 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14" returned: 0 in 0.843s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:22 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14 Jul 07 17:37:22 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Creating offline snapshot 824841f5-d85a-4c69-b942-f4d328fe2351 of volume 8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcb7552-80d4-45f9-b9f5-e19bb0b622d3]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:23 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f Jul 07 17:37:23 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:23 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82.377849e5-4fb4-439a-a6af-4ac5cfc90a14" returned: 0 in 0.723s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-377849e5-4fb4-439a-a6af-4ac5cfc90a14" released by "_delete_snapshot" :: held 3.554s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-39308b8f-8e0b-444d-a744-5c6cabc33d82" released by "delete_snapshot" :: held 3.579s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Created reservations ['313de7eb-fba4-46ce-9a85-b655364bbdb9', '0d76a5cb-e743-4cb5-b040-d39917f1ee1e', '13cee3ca-f485-4786-b0de-993f71869544', '0ecd72bc-2236-40a6-a23f-ba619a441019'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Delete snapshot completed successfully. Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-cb4064e1-1750-4615-b21f-f19cafe32e53 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-377849e5-4fb4-439a-a6af-4ac5cfc90a14-delete_snapshot" released by "delete_snapshot" :: held 3.745s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-39308b8f-8e0b-444d-a744-5c6cabc33d82-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-39308b8f-8e0b-444d-a744-5c6cabc33d82-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-quobyte-39308b8f-8e0b-444d-a744-5c6cabc33d82" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-39308b8f-8e0b-444d-a744-5c6cabc33d82" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:23 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f" returned: 0 in 1.114s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 2G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9438f426-e2f5-497f-bcbc-2f0ad1610f48]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:24 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 2G Jul 07 17:37:24 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:24 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:24 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:24 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 0.891s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:24 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82 Jul 07 17:37:24 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:25 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 2G" returned: 0 in 1.210s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f85798f-36f8-4308-8ed5-28eab445b70f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:25 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f85798f-36f8-4308-8ed5-28eab445b70f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 Jul 07 17:37:25 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:25 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-39308b8f-8e0b-444d-a744-5c6cabc33d82" returned: 0 in 0.705s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-39308b8f-8e0b-444d-a744-5c6cabc33d82" released by "delete_volume" :: held 1.708s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Created reservations ['308a0d30-1762-4690-9b10-771930f4e386', 'c5bc2c57-ac5b-41e3-841c-d5758f48917b', '4ddfd573-36e3-4706-8851-5234e670e804', '58e52170-c89e-468a-a085-fb82d9898ebd'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:25 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:25 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:26 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f85798f-36f8-4308-8ed5-28eab445b70f -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351" returned: 0 in 0.858s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:26 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 is being set with open permissions: ugo+rw Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:26 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 Jul 07 17:37:26 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-071534ca-9f82-4c09-b575-49317f0792eb-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-071534ca-9f82-4c09-b575-49317f0792eb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "cinder-quobyte-071534ca-9f82-4c09-b575-49317f0792eb" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-071534ca-9f82-4c09-b575-49317f0792eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e29828-0afd-4205-ae0a-88ce1a29dad7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:26 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb Jul 07 17:37:26 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:26 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.888s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Deleted volume successfully. Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-01dde6dd-059a-4dc4-a359-61606021af80 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-39308b8f-8e0b-444d-a744-5c6cabc33d82-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:26 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351" returned: 0 in 0.823s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:26 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info Jul 07 17:37:26 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:27 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb" returned: 0 in 1.105s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:27 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb Jul 07 17:37:27 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:27 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info" returned: 0 in 0.869s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:27 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info is being set with open permissions: ugo+rw Jul 07 17:37:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:27 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info Jul 07 17:37:27 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:28 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-071534ca-9f82-4c09-b575-49317f0792eb" returned: 0 in 0.769s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-quobyte-071534ca-9f82-4c09-b575-49317f0792eb" released by "delete_volume" :: held 1.938s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Created reservations ['22a90170-be18-44c6-834b-316ad3062957', '8ee41b04-3952-4ede-908c-405988208319', '419a1550-d2a3-470f-8a2e-7240829c7cca', 'e55d03d4-37e8-4bf2-954d-39feb010c581'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:28 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:28 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:28 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.info" returned: 0 in 0.895s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.893s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-684f92c5-0c97-47a1-83fc-58691fa31260 tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Create snapshot completed successfully Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "cinder-824841f5-d85a-4c69-b942-f4d328fe2351-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-824841f5-d85a-4c69-b942-f4d328fe2351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:29 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "cinder-quobyte-8f85798f-36f8-4308-8ed5-28eab445b70f" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.855s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Deleted volume successfully. Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-quobyte-8f85798f-36f8-4308-8ed5-28eab445b70f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "cinder-quobyte-824841f5-d85a-4c69-b942-f4d328fe2351" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-quobyte-824841f5-d85a-4c69-b942-f4d328fe2351" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Deleting offline snapshot 824841f5-d85a-4c69-b942-f4d328fe2351 of volume 8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] snapshot_file for this snap is: volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ee277725-364c-4e39-80d4-5d6afcc4fa81 tempest-VolumeDependencyTests-1938138273 None] Lock "cinder-071534ca-9f82-4c09-b575-49317f0792eb-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[53640481-a528-4728-9a2e-006f5836b950]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:29 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 Jul 07 17:37:29 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:30 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351" returned: 0 in 1.003s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f85798f-36f8-4308-8ed5-28eab445b70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:37:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1e63d1-9a38-4180-b935-91f153090658]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:30 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f Jul 07 17:37:30 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:31 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f" returned: 0 in 1.209s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:31 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 Jul 07 17:37:31 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:32 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351" returned: 0 in 1.032s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:32 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:32 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:32 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351 Jul 07 17:37:32 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:33 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f.824841f5-d85a-4c69-b942-f4d328fe2351" returned: 0 in 0.850s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:33 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-quobyte-824841f5-d85a-4c69-b942-f4d328fe2351" released by "_delete_snapshot" :: held 4.239s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.936s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-quobyte-8f85798f-36f8-4308-8ed5-28eab445b70f" released by "delete_snapshot" :: held 4.282s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Created reservations ['42030dc5-ce69-49e2-b119-ff45722259af', '2614563c-e94d-420f-9a7d-547215a989e4', 'baa26bf2-1e9c-415c-99d6-c571658fe3ce', '0c09215a-9e67-45a6-8f0b-7c21f8f52e0b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Delete snapshot completed successfully. Jul 07 17:37:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3d04ce5e-de0a-46ce-8e96-9ee63e8874ac tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-824841f5-d85a-4c69-b942-f4d328fe2351-delete_snapshot" released by "delete_snapshot" :: held 4.550s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "cinder-8f85798f-36f8-4308-8ed5-28eab445b70f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-8f85798f-36f8-4308-8ed5-28eab445b70f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "cinder-quobyte-8f85798f-36f8-4308-8ed5-28eab445b70f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-quobyte-8f85798f-36f8-4308-8ed5-28eab445b70f" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9105f136-d740-4797-85c0-444aae43d7b5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:35 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f Jul 07 17:37:35 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:35 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f" returned: 0 in 0.800s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:35 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f Jul 07 17:37:35 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Flow 'volume_create_manager' (659aeaf8-9150-493f-85a7-6a75b22b5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea1ba7d-bd02-4a2f-b2b2-f10790df208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:36 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-8f85798f-36f8-4308-8ed5-28eab445b70f" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea1ba7d-bd02-4a2f-b2b2-f10790df208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3b81fe-8291-40a0-bea8-e358bf132a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4382788565fc4692af5e34aee2eeee59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:36Z,use_quota=True,user_id='9e4a0ad561304486834024333f7ef1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fca54e-d796-446e-b297-d65f9a2c06da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fca54e-d796-446e-b297-d65f9a2c06da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693c2a68-f532-4c01-bb43-dd42cff2eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-quobyte-8f85798f-36f8-4308-8ed5-28eab445b70f" released by "delete_volume" :: held 1.624s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Created reservations ['7b2726a3-a944-4a07-8275-7f3707381246', '6bb05374-89a2-4f69-b145-cdda6d21d14f', '7b0838b9-8adb-4e37-9307-8f33f3d34f58', '8bfce528-e0a1-40a5-99e7-242f4a411bbc'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:36 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:36 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693c2a68-f532-4c01-bb43-dd42cff2eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c3b81fe-8291-40a0-bea8-e358bf132a03', 'volume_name': 'volume-6c3b81fe-8291-40a0-bea8-e358bf132a03', 'volume_size': 1, 'image_id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3131e4e-f433-435f-b200-a204e4f8b20f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec3d8f23c7f9121667039cc2829fc4f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4382788565fc4692af5e34aee2eeee59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4dbb730002bf17d33e818ee7a38c09f33ed43e7df3af5be9f3df0e98acaa234da1ccbd6a8994a1f7d77c7ec3b7fb9df8c7d1970ba929b76f8ee5e7fe93d62828', 'id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'created_at': datetime.datetime(2026, 7, 7, 15, 37, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 37, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3131e4e-f433-435f-b200-a204e4f8b20f/file', 'properties': {}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068bf3e6-5f2d-4a5a-83ab-9df850a21a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068bf3e6-5f2d-4a5a-83ab-9df850a21a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da87bb7-b16d-4a0b-8ba5-e260ef31c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:36 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Volume 6c3b81fe-8291-40a0-bea8-e358bf132a03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c3b81fe-8291-40a0-bea8-e358bf132a03', 'volume_size': 1, 'image_id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3131e4e-f433-435f-b200-a204e4f8b20f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec3d8f23c7f9121667039cc2829fc4f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4382788565fc4692af5e34aee2eeee59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4dbb730002bf17d33e818ee7a38c09f33ed43e7df3af5be9f3df0e98acaa234da1ccbd6a8994a1f7d77c7ec3b7fb9df8c7d1970ba929b76f8ee5e7fe93d62828', 'id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'created_at': datetime.datetime(2026, 7, 7, 15, 37, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 37, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3131e4e-f433-435f-b200-a204e4f8b20f/file', 'properties': {}}, 'image_service': } Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Trying to clone 6c3b81fe-8291-40a0-bea8-e358bf132a03 from image c3131e4e-f433-435f-b200-a204e4f8b20f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3131e4e-f433-435f-b200-a204e4f8b20f', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:37:36 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c00aa-afed-481b-bba3-89e71b633066]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:37 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD Jul 07 17:37:37 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:37 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.851s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:37 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Deleted volume successfully. Jul 07 17:37:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2ce28580-6ec2-445a-97e0-c3dbaef6b50e tempest-VolumesSnapshotNegativeTestJSON-254021986 None] Lock "cinder-8f85798f-36f8-4308-8ed5-28eab445b70f-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:37 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:37 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD Jul 07 17:37:37 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:38 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD" returned: 1 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:38 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Temporary image c3131e4e-f433-435f-b200-a204e4f8b20f is fetched for user 9e4a0ad561304486834024333f7ef1a4. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:37:38 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca8743-8e0b-4a1c-9731-3c85cf7a2625]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:38 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD Jul 07 17:37:38 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:39 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:39 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD Jul 07 17:37:39 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:40 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3b81fe-8291-40a0-bea8-e358bf132a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4382788565fc4692af5e34aee2eeee59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:36Z,use_quota=True,user_id='9e4a0ad561304486834024333f7ef1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Creating volume 6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:40 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:37:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:40 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 1073741824 Jul 07 17:37:40 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:41 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 1073741824" returned: 0 in 1.157s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:41 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:41 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:42 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:INSERT=38,cinder:UPDATE=139,cinder:SELECT=106,cinder:DELETE=8 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=103,cinder:INSERT=38,cinder:UPDATE=108,cinder:DELETE=10 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Attempting download of c3131e4e-f433-435f-b200-a204e4f8b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/c3131e4e-f433-435f-b200-a204e4f8b20f', 'metadata': {}}])) to volume 6c3b81fe-8291-40a0-bea8-e358bf132a03. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c80d9-667f-4621-84f9-629d18ec5895]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:42 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5 Jul 07 17:37:42 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:43 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5" returned: 0 in 0.795s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:43 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5 Jul 07 17:37:43 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:44 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5" returned: 1 in 0.805s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3131e4e-f433-435f-b200-a204e4f8b20f_3_e3t6d5' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[da323fe6-d43f-47e9-851c-b998aba1b6fb]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:44 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD Jul 07 17:37:44 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:45 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:45 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD Jul 07 17:37:45 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:45 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD" returned: 1 in 0.762s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:45 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] c3131e4e-f433-435f-b200-a204e4f8b20f was raw, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:37:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:45 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:45 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:46 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 0 in 0.815s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:46 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3131e4e-f433-435f-b200-a204e4f8b20f_bm7wsn9jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:37:46 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:37:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:46 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 1G Jul 07 17:37:46 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:47 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 1G" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eba577-6785-420a-a0fe-7a3899ea3df1]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:47 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:47 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:48 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 0 in 0.834s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:48 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:48 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:49 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 1 in 0.849s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Downloaded image c3131e4e-f433-435f-b200-a204e4f8b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/c3131e4e-f433-435f-b200-a204e4f8b20f', 'metadata': {}}])) to volume 6c3b81fe-8291-40a0-bea8-e358bf132a03 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Temporary image c3131e4e-f433-435f-b200-a204e4f8b20f for user 9e4a0ad561304486834024333f7ef1a4 is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Marking volume 6c3b81fe-8291-40a0-bea8-e358bf132a03 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Copying metadata from image c3131e4e-f433-435f-b200-a204e4f8b20f to 6c3b81fe-8291-40a0-bea8-e358bf132a03. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Creating volume glance metadata for volume 6c3b81fe-8291-40a0-bea8-e358bf132a03 backed by image c3131e4e-f433-435f-b200-a204e4f8b20f with: {'image_id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ec3d8f23c7f9121667039cc2829fc4f5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da87bb7-b16d-4a0b-8ba5-e260ef31c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3b81fe-8291-40a0-bea8-e358bf132a03', 'volume_size': 1, 'image_id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3131e4e-f433-435f-b200-a204e4f8b20f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ec3d8f23c7f9121667039cc2829fc4f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4382788565fc4692af5e34aee2eeee59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4dbb730002bf17d33e818ee7a38c09f33ed43e7df3af5be9f3df0e98acaa234da1ccbd6a8994a1f7d77c7ec3b7fb9df8c7d1970ba929b76f8ee5e7fe93d62828', 'id': 'c3131e4e-f433-435f-b200-a204e4f8b20f', 'created_at': datetime.datetime(2026, 7, 7, 15, 37, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 37, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3131e4e-f433-435f-b200-a204e4f8b20f/file', 'properties': {}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d402bdf2-d965-469d-b057-7c8847f343e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Volume volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 (6c3b81fe-8291-40a0-bea8-e358bf132a03): created successfully Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d402bdf2-d965-469d-b057-7c8847f343e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Flow 'volume_create_manager' (659aeaf8-9150-493f-85a7-6a75b22b5bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3282b4b9-716d-4b5a-b70a-bf11614b2d8f tempest-VolumeImageDependencyTests-491416268 None] Created volume successfully. Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Acquiring lock "cinder-6c3b81fe-8291-40a0-bea8-e358bf132a03-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Lock "cinder-6c3b81fe-8291-40a0-bea8-e358bf132a03-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Acquiring lock "cinder-quobyte-6c3b81fe-8291-40a0-bea8-e358bf132a03" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Lock "cinder-quobyte-6c3b81fe-8291-40a0-bea8-e358bf132a03" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2c555-080f-4e76-bf20-89cad46af582]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:49 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:49 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:50 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 0 in 0.890s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:50 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:50 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:51 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 1 in 1.020s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:37:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:51 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03 Jul 07 17:37:51 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:52 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6c3b81fe-8291-40a0-bea8-e358bf132a03" returned: 0 in 0.775s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Lock "cinder-quobyte-6c3b81fe-8291-40a0-bea8-e358bf132a03" released by "delete_volume" :: held 2.776s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Created reservations ['49b2401c-1664-424a-a69e-06aa3fe090d0', '6c0cf380-36bc-43a3-8e47-411b8e6e3719', '07fc9ac4-6283-436d-8db6-9c4a2d4e76ae', '04b6b532-aa6a-49fc-94cc-6dcdaa81459e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:52 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:37:52 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:53 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.255s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:53 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Deleted volume successfully. Jul 07 17:37:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6769ef65-e892-45f2-8994-beb68daa8beb tempest-VolumeImageDependencyTests-491416268 None] Lock "cinder-6c3b81fe-8291-40a0-bea8-e358bf132a03-delete_volume" released by "delete_volume" :: held 4.305s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:37:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-fcab4ee9-9206-4156-a2cf-15ebf5fa76f0 req-b7aff024-91e6-4088-a0d4-e2b3b4efe3a7 tempest-TestShelveInstance-1790340110 None] Terminate volume connection completed successfully. Jul 07 17:37:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-fcab4ee9-9206-4156-a2cf-15ebf5fa76f0 req-b7aff024-91e6-4088-a0d4-e2b3b4efe3a7 tempest-TestShelveInstance-1790340110 None] Deleting attachment dcdc59f6-c711-409e-a851-6352fd6982ee. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:38:03 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:38:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a1579-9a93-434b-8db8-6946083279ce]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:05 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:38:05 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:06 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 0.766s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:06 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:38:06 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:07 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 1 in 0.835s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.657s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b96d66d9-8371-4276-8305-88e271e604ec', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:38:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-4a65835c-d32f-4a8f-b2d0-902c87cb84c1 req-060fd1dc-5add-447e-8ec5-5fe2b9d05b09 tempest-TestShelveInstance-1790340110 None] attachment_update completed successfully. Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Flow 'volume_create_manager' (13956b7f-f2a0-4b3e-bfab-5285a8653082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c8ab74-62ff-4c71-9651-15840e94bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c8ab74-62ff-4c71-9651-15840e94bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-824389350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd141c23-011c-4c22-bf6e-d7629289b65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1cf8e0369a4416ae9d2ac781a180d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:08Z,use_quota=True,user_id='0b5d5a0d9d34406da1b9cf41af8e6292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38089e80-976f-4420-8476-304927eccebf),volume_type_id=38089e80-976f-4420-8476-304927eccebf)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21eb493a-2b39-494c-a709-9bb90ed05ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21eb493a-2b39-494c-a709-9bb90ed05ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f821a4ab-470f-45b2-85d4-3bf63bde5e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f821a4ab-470f-45b2-85d4-3bf63bde5e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd141c23-011c-4c22-bf6e-d7629289b65d', 'volume_name': 'volume-dd141c23-011c-4c22-bf6e-d7629289b65d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46032709-4933-4c94-a4da-19f450a66f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46032709-4933-4c94-a4da-19f450a66f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4568ced5-531b-4050-8106-b921a0f05ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:07 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume dd141c23-011c-4c22-bf6e-d7629289b65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd141c23-011c-4c22-bf6e-d7629289b65d', 'volume_size': 1} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-824389350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd141c23-011c-4c22-bf6e-d7629289b65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1cf8e0369a4416ae9d2ac781a180d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:08Z,use_quota=True,user_id='0b5d5a0d9d34406da1b9cf41af8e6292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38089e80-976f-4420-8476-304927eccebf),volume_type_id=38089e80-976f-4420-8476-304927eccebf)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Creating volume dd141c23-011c-4c22-bf6e-d7629289b65d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:08 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:08 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d 1073741824 Jul 07 17:38:08 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Flow 'volume_create_manager' (c2d7412e-391c-45e5-9779-5859fe767ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3243f767-7151-450f-835e-b41d239097b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3243f767-7151-450f-835e-b41d239097b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1237921676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c58ade5-6f0d-4e40-a922-91a1ab98ea47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1cf8e0369a4416ae9d2ac781a180d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:08Z,use_quota=True,user_id='0b5d5a0d9d34406da1b9cf41af8e6292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26163cee-881d-46bb-ac2e-7aa2a1f87f39),volume_type_id=26163cee-881d-46bb-ac2e-7aa2a1f87f39)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c457b0-3829-478d-9049-3688b64bc625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c457b0-3829-478d-9049-3688b64bc625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1394f4bc-ed3e-4a12-b03b-cfa531936076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1394f4bc-ed3e-4a12-b03b-cfa531936076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c58ade5-6f0d-4e40-a922-91a1ab98ea47', 'volume_name': 'volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf08994a-31c0-48b2-a8cf-45e6f3498cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf08994a-31c0-48b2-a8cf-45e6f3498cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93992982-9b95-4bf2-a369-e35ac5fe3eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume 3c58ade5-6f0d-4e40-a922-91a1ab98ea47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47', 'volume_size': 1} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Flow 'volume_create_manager' (97c37131-60d8-47cc-ac53-970deb3dbcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab235e87-e31e-4bcf-8cd0-66cb7fb8796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab235e87-e31e-4bcf-8cd0-66cb7fb8796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-619860231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1fd1b9-1cdb-4c13-a245-e855d67b0053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1cf8e0369a4416ae9d2ac781a180d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:09Z,use_quota=True,user_id='0b5d5a0d9d34406da1b9cf41af8e6292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a391c58c-df28-494b-a844-2fe6aa93b8c6),volume_type_id=a391c58c-df28-494b-a844-2fe6aa93b8c6)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5384fba7-5d29-4513-96a8-157299f6cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5384fba7-5d29-4513-96a8-157299f6cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed300284-b562-4cc2-8770-fe5723373a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:08 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:38:09 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d 1073741824" returned: 0 in 1.019s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:09 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d Jul 07 17:38:09 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed300284-b562-4cc2-8770-fe5723373a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e1fd1b9-1cdb-4c13-a245-e855d67b0053', 'volume_name': 'volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053', 'volume_size': 1, 'image_id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1731540147', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fd1cf8e0369a4416ae9d2ac781a180d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'created_at': datetime.datetime(2026, 7, 7, 15, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4/file', 'properties': {}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd13662-3a79-4584-8432-1bfe55ed2357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd13662-3a79-4584-8432-1bfe55ed2357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecec112c-53c1-4008-8dc7-ae1c527edc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume 9e1fd1b9-1cdb-4c13-a245-e855d67b0053: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053', 'volume_size': 1, 'image_id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1731540147', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fd1cf8e0369a4416ae9d2ac781a180d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'created_at': datetime.datetime(2026, 7, 7, 15, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4/file', 'properties': {}}, 'image_service': } Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Trying to clone 9e1fd1b9-1cdb-4c13-a245-e855d67b0053 from image bf4ed058-6695-4509-ab4a-5f92a793bdd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:38:09 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d" returned: 0 in 0.681s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.337s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1237921676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c58ade5-6f0d-4e40-a922-91a1ab98ea47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1cf8e0369a4416ae9d2ac781a180d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:08Z,use_quota=True,user_id='0b5d5a0d9d34406da1b9cf41af8e6292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26163cee-881d-46bb-ac2e-7aa2a1f87f39),volume_type_id=26163cee-881d-46bb-ac2e-7aa2a1f87f39)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Creating volume 3c58ade5-6f0d-4e40-a922-91a1ab98ea47 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4568ced5-531b-4050-8106-b921a0f05ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd141c23-011c-4c22-bf6e-d7629289b65d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:09 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 1073741824 Jul 07 17:38:09 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c248af6-c533-4ec3-8b6b-0db1b36a60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume volume-dd141c23-011c-4c22-bf6e-d7629289b65d (dd141c23-011c-4c22-bf6e-d7629289b65d): created successfully Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c248af6-c533-4ec3-8b6b-0db1b36a60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Flow 'volume_create_manager' (13956b7f-f2a0-4b3e-bfab-5285a8653082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e8ae5bcb-9bde-458d-a849-97d74d11aa35 tempest-TestInstancesWithCinderVolumes-1046618257 None] Created volume successfully. Jul 07 17:38:10 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 1073741824" returned: 0 in 1.122s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:10 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 Jul 07 17:38:10 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:11 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" returned: 0 in 0.730s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93992982-9b95-4bf2-a369-e35ac5fe3eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253d22dc-1f0f-4c21-8098-f0bd36d57f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 (3c58ade5-6f0d-4e40-a922-91a1ab98ea47): created successfully Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253d22dc-1f0f-4c21-8098-f0bd36d57f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Flow 'volume_create_manager' (c2d7412e-391c-45e5-9779-5859fe767ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c5351194-2d75-47ab-abd6-3151f7bc77b0 tempest-TestInstancesWithCinderVolumes-1046618257 None] Created volume successfully. Jul 07 17:38:12 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD, size 20.69 MB, duration 3.41 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:38:12 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Image download 20.69 MB at 6.07 MB/s Jul 07 17:38:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3ee710-bb0d-4a6f-8f60-68573afacf0a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:12 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD Jul 07 17:38:12 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:13 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:13 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Temporary image bf4ed058-6695-4509-ab4a-5f92a793bdd4 is fetched for user 0b5d5a0d9d34406da1b9cf41af8e6292. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:38:13 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5bfdc5-c472-4d51-b706-46c671c59e95]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:13 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD Jul 07 17:38:13 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:14 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-619860231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1fd1b9-1cdb-4c13-a245-e855d67b0053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1cf8e0369a4416ae9d2ac781a180d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:09Z,use_quota=True,user_id='0b5d5a0d9d34406da1b9cf41af8e6292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a391c58c-df28-494b-a844-2fe6aa93b8c6),volume_type_id=a391c58c-df28-494b-a844-2fe6aa93b8c6)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Creating volume 9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:14 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:38:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:14 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 1073741824 Jul 07 17:38:14 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:15 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 1073741824" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:15 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:38:15 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:15 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 0 in 0.768s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Attempting download of bf4ed058-6695-4509-ab4a-5f92a793bdd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'metadata': {}}])) to volume 9e1fd1b9-1cdb-4c13-a245-e855d67b0053. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87330e4-2670-4a34-9280-a40d62a4b5f0]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:16 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i Jul 07 17:38:16 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:16 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i" returned: 0 in 1.030s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:17 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i Jul 07 17:38:17 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:17 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i" returned: 1 in 0.832s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf4ed058-6695-4509-ab4a-5f92a793bdd4_omimfx_i' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:38:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ddfe1-304c-429b-9025-9b189993e943]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:17 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD Jul 07 17:38:17 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:18 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:18 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] bf4ed058-6695-4509-ab4a-5f92a793bdd4 was qcow2, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:38:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:18 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:38:18 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:21 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 0 in 2.523s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:21 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf4ed058-6695-4509-ab4a-5f92a793bdd4_syco7qjodevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:38:21 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Converted 112.00 MB image at 44.36 MB/s Jul 07 17:38:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:21 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 1G Jul 07 17:38:21 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:22 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 1G" returned: 0 in 0.879s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2224a500-ca26-492f-abc2-2922efddd98f]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:22 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:38:22 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:22 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 0 in 0.842s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:23 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:38:23 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:23 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 1 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Downloaded image bf4ed058-6695-4509-ab4a-5f92a793bdd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'metadata': {}}])) to volume 9e1fd1b9-1cdb-4c13-a245-e855d67b0053 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Temporary image bf4ed058-6695-4509-ab4a-5f92a793bdd4 for user 0b5d5a0d9d34406da1b9cf41af8e6292 is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Marking volume 9e1fd1b9-1cdb-4c13-a245-e855d67b0053 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Copying metadata from image bf4ed058-6695-4509-ab4a-5f92a793bdd4 to 9e1fd1b9-1cdb-4c13-a245-e855d67b0053. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Creating volume glance metadata for volume 9e1fd1b9-1cdb-4c13-a245-e855d67b0053 backed by image bf4ed058-6695-4509-ab4a-5f92a793bdd4 with: {'image_id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'image_name': 'tempest-scenario-img--1731540147', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecec112c-53c1-4008-8dc7-ae1c527edc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053', 'volume_size': 1, 'image_id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1731540147', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fd1cf8e0369a4416ae9d2ac781a180d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf4ed058-6695-4509-ab4a-5f92a793bdd4', 'created_at': datetime.datetime(2026, 7, 7, 15, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf4ed058-6695-4509-ab4a-5f92a793bdd4/file', 'properties': {}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816a181f-f013-42ab-8906-7ea0ebd9290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:23 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Volume volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 (9e1fd1b9-1cdb-4c13-a245-e855d67b0053): created successfully Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816a181f-f013-42ab-8906-7ea0ebd9290c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:23 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Flow 'volume_create_manager' (97c37131-60d8-47cc-ac53-970deb3dbcc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7f3cabcb-96fd-4efd-8693-98892aeed5b2 tempest-TestInstancesWithCinderVolumes-1046618257 None] Created volume successfully. Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507cac4-e746-4351-9c6c-86790c47ccec]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:32 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:38:32 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:32 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:38:32 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:33 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 0 in 0.942s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:33 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:38:33 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:33 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.685s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:38:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:38:34 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 1 in 1.010s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:38:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.004s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '275c32ca-cf14-41d9-ae2a-f09c1bd761e9', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:38:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-41c656db-2283-4ae1-a360-19e8609dbe61 req-84a684bd-3893-44d0-86d1-10065f7c2090 tempest-TestInstancesWithCinderVolumes-1046618257 None] attachment_update completed successfully. Jul 07 17:38:44 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=33,cinder:INSERT=15,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:38:44 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=25,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:39:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-f371a246-82ff-4213-9793-061e2f2050b9 tempest-TestShelveInstance-1790340110 None] Terminate volume connection completed successfully. Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-f371a246-82ff-4213-9793-061e2f2050b9 tempest-TestShelveInstance-1790340110 None] Deleting attachment b96d66d9-8371-4276-8305-88e271e604ec. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Acquiring lock "cinder-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Lock "cinder-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Acquiring lock "cinder-quobyte-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Lock "cinder-quobyte-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[694ce6e3-cc2e-4d49-968f-3dd8d8f4dbda]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:01 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:39:01 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:02 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 0.821s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:02 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:39:02 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:03 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 1 in 0.771s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:03 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547 Jul 07 17:39:03 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:04 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" returned: 0 in 0.664s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Lock "cinder-quobyte-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547" released by "delete_volume" :: held 2.333s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG cinder.quota [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Created reservations ['d99872f1-82c4-4b98-b8fb-a2d778fc5a3b', 'a661f9ed-8335-40b1-9476-92a3929655b7', '7ecb4e45-d3f9-40da-bda5-2aa502a699e9', '0e429b7d-ad12-42db-8f31-914fbbec6e0f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:04 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:39:04 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:05 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.777s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:05 devstack cinder-volume[87251]: DEBUG cinder.manager [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Deleted volume successfully. Jul 07 17:39:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [req-9ba76d64-1728-497a-98d6-8b869712fc5a req-1b399dfa-4ea1-492c-b7a2-6c51d8ed7cdf tempest-TestShelveInstance-1790340110 None] Lock "cinder-ea6ab4b2-a34b-4b77-b3b6-2b9c6fec7547-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeadc40-f781-42ab-999e-a5ed029ae6ff]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:11 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d Jul 07 17:39:11 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:11 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d" returned: 0 in 0.949s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-dd141c23-011c-4c22-bf6e-d7629289b65d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6e28d43-3b63-41c9-b9b6-3ee2425c4439', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:39:12 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-5683dd80-b82a-4059-aab2-5f847b55f547 req-88565f06-788d-42e3-9f2a-ade2167b38c8 tempest-TestInstancesWithCinderVolumes-1046618257 None] attachment_update completed successfully. Jul 07 17:39:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[33125724-e80b-4a98-9649-b12472b43b45]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:20 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 Jul 07 17:39:20 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:21 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" returned: 0 in 0.964s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.992s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a7a4e37-ba76-495e-806c-1413882f0e0e', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:39:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-4dc1441c-b5ee-4b23-aba5-9339bedd238f req-20fbf7a4-ac89-47cb-a9a9-7f6e01d5cc0d tempest-TestInstancesWithCinderVolumes-1046618257 None] attachment_update completed successfully. Jul 07 17:39:30 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-6653d9c6-62e4-4679-a852-889b8e5938c7 req-777234b1-b1c5-45de-b28d-1c389507f0a8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Terminate volume connection completed successfully. Jul 07 17:39:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-6653d9c6-62e4-4679-a852-889b8e5938c7 req-777234b1-b1c5-45de-b28d-1c389507f0a8 tempest-TestInstancesWithCinderVolumes-1046618257 None] Deleting attachment e6e28d43-3b63-41c9-b9b6-3ee2425c4439. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:39:31 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=18,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "cinder-dd141c23-011c-4c22-bf6e-d7629289b65d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-dd141c23-011c-4c22-bf6e-d7629289b65d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "cinder-quobyte-dd141c23-011c-4c22-bf6e-d7629289b65d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-quobyte-dd141c23-011c-4c22-bf6e-d7629289b65d" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c37c27-df26-4daa-81c8-6767c41b0da5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:32 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:39:32 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:32 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d Jul 07 17:39:32 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:33 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.768s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:39:33 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d" returned: 0 in 0.899s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:33 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d Jul 07 17:39:33 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:34 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-dd141c23-011c-4c22-bf6e-d7629289b65d" returned: 0 in 0.708s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-quobyte-dd141c23-011c-4c22-bf6e-d7629289b65d" released by "delete_volume" :: held 1.657s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:34 devstack cinder-volume[87251]: WARNING cinder.quota [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1095752380-2138854222 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1095752380-2138854222, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:39:34 devstack cinder-volume[87251]: WARNING cinder.quota [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1095752380-2138854222 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1095752380-2138854222, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Created reservations ['42b478cf-b367-4f6f-bb12-1fae9755c426', 'f09ff528-cd8a-4cbf-ade2-db5f6ed3f96f', 'd34e2a65-c337-4c7c-8bc5-8700dd96ae0a', 'ff63a1ce-f868-4111-ba17-e5c64408245a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:34 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:39:34 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:35 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.711s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:35 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Deleted volume successfully. Jul 07 17:39:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-efd4a6b0-8e13-43b1-96a7-cbb6a1f2105b tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-dd141c23-011c-4c22-bf6e-d7629289b65d-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-bef15e34-b355-4ff6-b607-00d0830c71aa req-bc937cb1-471c-46ec-84ba-0262284b37d4 tempest-TestInstancesWithCinderVolumes-1046618257 None] Terminate volume connection completed successfully. Jul 07 17:39:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-bef15e34-b355-4ff6-b607-00d0830c71aa req-bc937cb1-471c-46ec-84ba-0262284b37d4 tempest-TestInstancesWithCinderVolumes-1046618257 None] Deleting attachment 2a7a4e37-ba76-495e-806c-1413882f0e0e. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:39:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "cinder-3c58ade5-6f0d-4e40-a922-91a1ab98ea47-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-3c58ade5-6f0d-4e40-a922-91a1ab98ea47-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "cinder-quobyte-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-quobyte-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:39 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[996956db-d1f9-4ff0-a95a-a18d12edf4b1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:39 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 Jul 07 17:39:39 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Flow 'volume_create_manager' (122fa9be-819f-4105-901b-843f1c6005e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9130fa73-bbcb-4912-ac9e-31b3a072e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9130fa73-bbcb-4912-ac9e-31b3a072e62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1990940030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c4c68-fee5-40be-8f50-fd0a9fe60cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e552ffe9593a48bc909b122b7f13ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:40Z,use_quota=True,user_id='8489eba2b23f4669a4d33701b5530abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d98eac4-0c28-43db-8e58-c508d5ea8655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d98eac4-0c28-43db-8e58-c508d5ea8655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776ad01d-0c12-494c-a786-61f890f6f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776ad01d-0c12-494c-a786-61f890f6f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74c4c68-fee5-40be-8f50-fd0a9fe60cb0', 'volume_name': 'volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2e6c20-a3ff-421c-a21b-62b5b35432b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2e6c20-a3ff-421c-a21b-62b5b35432b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa7a484-f663-4f4c-b3ea-cfef2fb5d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:40 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Volume e74c4c68-fee5-40be-8f50-fd0a9fe60cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0', 'volume_size': 1} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1990940030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c4c68-fee5-40be-8f50-fd0a9fe60cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e552ffe9593a48bc909b122b7f13ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:40Z,use_quota=True,user_id='8489eba2b23f4669a4d33701b5530abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Creating volume e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:40 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:40 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 1073741824 Jul 07 17:39:40 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:40 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" returned: 0 in 0.955s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:40 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47 Jul 07 17:39:40 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:41 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 1073741824" returned: 0 in 1.137s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:41 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:39:41 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:41 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" returned: 0 in 0.888s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-quobyte-3c58ade5-6f0d-4e40-a922-91a1ab98ea47" released by "delete_volume" :: held 1.913s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:41 devstack cinder-volume[87251]: WARNING cinder.quota [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551520618-1291214684 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551520618-1291214684, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:39:41 devstack cinder-volume[87251]: WARNING cinder.quota [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551520618-1291214684 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551520618-1291214684, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Created reservations ['cc500595-62bf-445a-a2b2-f8fd94ba5783', 'a89616c0-57a1-40f9-bd75-ee3b2015368a', '136881ba-1455-45ca-8291-f73f40d1248c', '197a0e3d-31be-4ea1-8f75-aeae15599e0c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:41 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:39:41 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:42 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 0.958s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa7a484-f663-4f4c-b3ea-cfef2fb5d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84c1833-db1c-4b50-b82e-49c6e3b892b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Volume volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 (e74c4c68-fee5-40be-8f50-fd0a9fe60cb0): created successfully Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84c1833-db1c-4b50-b82e-49c6e3b892b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Flow 'volume_create_manager' (122fa9be-819f-4105-901b-843f1c6005e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8c634412-9725-47a8-a336-f00e049e247c tempest-TestStampPattern-1415638084 None] Created volume successfully. Jul 07 17:39:42 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.940s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Deleted volume successfully. Jul 07 17:39:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-971e129d-71c9-4504-bffa-ea0ddcd99f2a tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-3c58ade5-6f0d-4e40-a922-91a1ab98ea47-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:47 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-8422bab1-f26e-401e-ae03-dd617d0a1df0 req-475ad164-7ddc-44e2-a3bb-6ac44982ac78 tempest-TestInstancesWithCinderVolumes-1046618257 None] Terminate volume connection completed successfully. Jul 07 17:39:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-8422bab1-f26e-401e-ae03-dd617d0a1df0 req-475ad164-7ddc-44e2-a3bb-6ac44982ac78 tempest-TestInstancesWithCinderVolumes-1046618257 None] Deleting attachment 275c32ca-cf14-41d9-ae2a-f09c1bd761e9. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:39:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "cinder-9e1fd1b9-1cdb-4c13-a245-e855d67b0053-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-9e1fd1b9-1cdb-4c13-a245-e855d67b0053-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "cinder-quobyte-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-quobyte-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" acquired by "delete_volume" :: waited 0.040s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1095281-e23c-4623-b5f9-dc7f7aee2002]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:50 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:39:50 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:51 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 0 in 0.922s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:51 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:39:51 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:52 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 1 in 0.829s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:52 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053 Jul 07 17:39:52 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:52 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" returned: 0 in 0.707s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-quobyte-9e1fd1b9-1cdb-4c13-a245-e855d67b0053" released by "delete_volume" :: held 2.560s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:53 devstack cinder-volume[87251]: WARNING cinder.quota [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1740398852-1133778521 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1740398852-1133778521, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:39:53 devstack cinder-volume[87251]: WARNING cinder.quota [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1740398852-1133778521 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1740398852-1133778521, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Created reservations ['7063767c-d476-438e-8e2a-51a89746498e', 'ac8517a8-9e9c-4fa5-bf6f-3dd5bfc8de25', 'e83e7ff2-f026-4af3-aa77-5a03610229f3', '22190c25-1c38-464e-bde9-6ee52784af88'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:53 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:39:53 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:53 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.798s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Deleted volume successfully. Jul 07 17:39:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fa2c8733-e687-45df-83e2-8ae313315758 tempest-TestInstancesWithCinderVolumes-1046618257 None] Lock "cinder-9e1fd1b9-1cdb-4c13-a245-e855d67b0053-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:03 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=37,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:03 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=4 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Flow 'volume_create_manager' (8cb9adee-1dca-4e9e-84d0-4f59555c0d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68e184b-0145-494b-995c-c0788f6370c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68e184b-0145-494b-995c-c0788f6370c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c43e93-97a3-4d4b-9463-9b40a3bd38c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4baf8549374446a8eaeeb4698527fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:07Z,use_quota=True,user_id='4594dff8ff3d47e7bb2d751097e4a2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0bb4ee-df84-441e-bca2-7c5f4ccf6a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0bb4ee-df84-441e-bca2-7c5f4ccf6a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02725c6c-46bd-420a-9988-d6beb7a3b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02725c6c-46bd-420a-9988-d6beb7a3b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c43e93-97a3-4d4b-9463-9b40a3bd38c5', 'volume_name': 'volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1b7c13-ebca-4f7a-9caa-e4f73220e10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1b7c13-ebca-4f7a-9caa-e4f73220e10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9efa995-ef9a-4f46-aac1-197b58ff45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:07 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Volume b2c43e93-97a3-4d4b-9463-9b40a3bd38c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5', 'volume_size': 1} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c43e93-97a3-4d4b-9463-9b40a3bd38c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4baf8549374446a8eaeeb4698527fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:07Z,use_quota=True,user_id='4594dff8ff3d47e7bb2d751097e4a2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Creating volume b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:07 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:40:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:07 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 1073741824 Jul 07 17:40:07 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:08 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 1073741824" returned: 0 in 0.876s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:08 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 Jul 07 17:40:08 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:09 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5" returned: 0 in 0.701s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9efa995-ef9a-4f46-aac1-197b58ff45db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c80ea75-72c0-42f4-b313-4bc995b09216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Volume volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 (b2c43e93-97a3-4d4b-9463-9b40a3bd38c5): created successfully Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c80ea75-72c0-42f4-b313-4bc995b09216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Flow 'volume_create_manager' (8cb9adee-1dca-4e9e-84d0-4f59555c0d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f8aca471-8050-430a-aae3-0f553bd3190b tempest-CinderUnicodeTest-1258128512 None] Created volume successfully. Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Flow 'volume_create_manager' (fa046449-3453-4d09-8d3d-ebe4563c1026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a0b1e2-8a8d-4973-97b1-5c50d564cad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a0b1e2-8a8d-4973-97b1-5c50d564cad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-963243486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4b9766-ebfa-4967-853b-4e0c6f01cfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4baf8549374446a8eaeeb4698527fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:10Z,use_quota=True,user_id='4594dff8ff3d47e7bb2d751097e4a2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a084fdec-355e-4cdd-ae10-147956277e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a084fdec-355e-4cdd-ae10-147956277e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d794b0cd-9cf1-45ff-b339-c8abc9b2b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d794b0cd-9cf1-45ff-b339-c8abc9b2b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4b9766-ebfa-4967-853b-4e0c6f01cfd3', 'volume_name': 'volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabdd30b-1399-4edc-b0aa-9c895cc4acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabdd30b-1399-4edc-b0aa-9c895cc4acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a05986-cb72-4082-b967-3655612e9089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:10 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Volume fa4b9766-ebfa-4967-853b-4e0c6f01cfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3', 'volume_size': 1} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-963243486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4b9766-ebfa-4967-853b-4e0c6f01cfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4baf8549374446a8eaeeb4698527fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:10Z,use_quota=True,user_id='4594dff8ff3d47e7bb2d751097e4a2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Creating volume fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:10 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:40:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:10 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 1073741824 Jul 07 17:40:10 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:11 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 1073741824" returned: 0 in 0.839s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:11 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 Jul 07 17:40:11 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:11 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" returned: 0 in 0.732s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a05986-cb72-4082-b967-3655612e9089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c689f9-8d1e-40f1-a004-9a8b58498d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Volume volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 (fa4b9766-ebfa-4967-853b-4e0c6f01cfd3): created successfully Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c689f9-8d1e-40f1-a004-9a8b58498d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Flow 'volume_create_manager' (fa046449-3453-4d09-8d3d-ebe4563c1026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-19a1bb98-d080-4403-8cbf-8f74483bf797 tempest-CinderUnicodeTest-1258128512 None] Created volume successfully. Jul 07 17:40:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Creating offline snapshot 9b410247-1780-4950-bd6e-dd45df5ba8af of volume fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:40:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[21231025-518b-4245-bf8e-c24222dee26d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:12 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 Jul 07 17:40:12 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:13 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" returned: 0 in 0.751s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:13 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af 1G Jul 07 17:40:13 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:14 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af 1G" returned: 0 in 0.849s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:14 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af Jul 07 17:40:14 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:14 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af" returned: 0 in 0.697s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:14 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af is being set with open permissions: ugo+rw Jul 07 17:40:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:14 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af Jul 07 17:40:14 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:15 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af" returned: 0 in 0.635s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:15 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info Jul 07 17:40:15 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:16 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info" returned: 0 in 0.641s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:16 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info is being set with open permissions: ugo+rw Jul 07 17:40:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:16 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info Jul 07 17:40:16 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:16 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.info" returned: 0 in 0.618s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.319s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6a34c5ee-986a-41d4-8fb7-efcf3170d699 tempest-CinderUnicodeTest-1258128512 None] Create snapshot completed successfully Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-9b410247-1780-4950-bd6e-dd45df5ba8af-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-9b410247-1780-4950-bd6e-dd45df5ba8af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-quobyte-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-quobyte-9b410247-1780-4950-bd6e-dd45df5ba8af" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-9b410247-1780-4950-bd6e-dd45df5ba8af" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Deleting offline snapshot 9b410247-1780-4950-bd6e-dd45df5ba8af of volume fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] snapshot_file for this snap is: volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6450b9-e645-47a5-85fe-d610016ede72]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:17 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af Jul 07 17:40:17 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:18 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:40:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572a438-51fa-4406-933c-fbbd702de163]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:18 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 Jul 07 17:40:18 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:19 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" returned: 0 in 0.771s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:19 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af Jul 07 17:40:19 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:20 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af" returned: 0 in 0.848s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:20 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af Jul 07 17:40:20 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c76784-6875-4b91-aef8-1d7e84db91e2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:21 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3.9b410247-1780-4950-bd6e-dd45df5ba8af" returned: 0 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-9b410247-1780-4950-bd6e-dd45df5ba8af" released by "_delete_snapshot" :: held 3.389s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" released by "delete_snapshot" :: held 3.414s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:21 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:40:21 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Created reservations ['9d23dc06-5594-4283-a8f0-ce043483178c', 'c365f49f-20a8-4fca-9087-0957d65056c8', 'e78d4e87-6239-4f26-8035-e122886a8d6c', '36fefa01-2516-4456-8c33-8896d3c92efd'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Delete snapshot completed successfully. Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-23fd5558-7fa9-47ec-80fd-a7ccb4e94b8d tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-9b410247-1780-4950-bd6e-dd45df5ba8af-delete_snapshot" released by "delete_snapshot" :: held 3.570s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:21 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.848s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a02fa116-b9d0-4835-9685-3a74b923fc02', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-b9833aa3-58ce-46e6-a2fe-2affa38f331c req-46d2acdd-2fa9-409f-a898-10d491b6aa0b tempest-TestStampPattern-1415638084 None] attachment_update completed successfully. Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-quobyte-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d4c9c-4c1d-483e-8bdb-38d3c159112c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:22 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 Jul 07 17:40:22 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:22 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" returned: 0 in 0.827s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:23 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3 Jul 07 17:40:23 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:23 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" returned: 0 in 0.713s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3" released by "delete_volume" :: held 1.601s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Created reservations ['3af12bd0-b4b3-4123-be9c-2808d68caedc', 'a4f91b9d-4408-48c6-9aed-b2fc0a50c4ba', '341a6df4-60da-4bf5-83cc-8eaed8a7792a', '13330781-297c-4b02-8fb0-39a9fd636588'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:23 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:40:23 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "cinder-quobyte-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd28fc5-fafa-4315-91e7-a0eaf1b84a58]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:24 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.652s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:24 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 Jul 07 17:40:24 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Deleted volume successfully. Jul 07 17:40:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a15b92fc-3cf1-4e96-b2ed-3509d2d2de25 tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-fa4b9766-ebfa-4967-853b-4e0c6f01cfd3-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:25 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5" returned: 0 in 0.791s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:25 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5 Jul 07 17:40:25 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:25 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-quobyte-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5" released by "delete_volume" :: held 1.486s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Created reservations ['05e05165-d5d7-4085-b690-c42eb3cc4da5', '69fd5cba-26a2-4658-9b40-5cdc70a1ba12', '2144ed4a-c014-48cb-9c23-564a68e06edc', '61963bc3-9bbf-49b6-9174-1bdc6fc97bff'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:25 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:40:25 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:26 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.663s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:26 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Deleted volume successfully. Jul 07 17:40:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1049c1f0-7455-4fe5-a74a-984381b9f1ad tempest-CinderUnicodeTest-1258128512 None] Lock "cinder-b2c43e93-97a3-4d4b-9463-9b40a3bd38c5-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-583867a8-53e7-433c-8d88-70d2ad9ca966 req-84ab1242-2b9c-4553-adc2-37f2edb8b98d tempest-TestStampPattern-1415638084 None] Terminate volume connection completed successfully. Jul 07 17:40:31 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-583867a8-53e7-433c-8d88-70d2ad9ca966 req-84ab1242-2b9c-4553-adc2-37f2edb8b98d tempest-TestStampPattern-1415638084 None] Deleting attachment a02fa116-b9d0-4835-9685-3a74b923fc02. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:32 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:40:32 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:33 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.678s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Creating offline snapshot 2f4bebe9-203b-4a5e-b460-4d6c15f81998 of volume e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:40:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04a987-7f6d-487f-bc8e-03e177d82938]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:34 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:40:34 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:34 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 0.813s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:34 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 1G Jul 07 17:40:34 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:35 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 1G" returned: 0 in 0.909s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:35 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 Jul 07 17:40:35 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:36 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998" returned: 0 in 0.763s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:36 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 is being set with open permissions: ugo+rw Jul 07 17:40:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:36 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 Jul 07 17:40:36 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:37 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998" returned: 0 in 0.692s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:37 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info Jul 07 17:40:37 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:38 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info" returned: 0 in 0.792s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:38 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info is being set with open permissions: ugo+rw Jul 07 17:40:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:38 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info Jul 07 17:40:38 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:38 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.info" returned: 0 in 0.725s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:38 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ff2b213a-2c3a-4bbd-adfc-9e627c9080c2 tempest-TestStampPattern-1415638084 None] Create snapshot completed successfully Jul 07 17:40:48 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=34,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:48 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Flow 'volume_create_manager' (43bfa4b0-1abd-4757-a8e6-83823af62bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ed670a-d2f9-4e8e-8715-e7f1e005f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ed670a-d2f9-4e8e-8715-e7f1e005f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1563819187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b61536-0367-4edd-b5b5-fb5e105e739f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e552ffe9593a48bc909b122b7f13ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f4bebe9-203b-4a5e-b460-4d6c15f81998,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:49Z,use_quota=True,user_id='8489eba2b23f4669a4d33701b5530abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af70adda-7db9-423c-892b-2a9b5b492a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af70adda-7db9-423c-892b-2a9b5b492a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdb84cd-cda2-4ea1-9260-32fda0c477b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdb84cd-cda2-4ea1-9260-32fda0c477b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5b61536-0367-4edd-b5b5-fb5e105e739f', 'volume_name': 'volume-c5b61536-0367-4edd-b5b5-fb5e105e739f', 'volume_size': 1, 'snapshot_id': '2f4bebe9-203b-4a5e-b460-4d6c15f81998'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d830ee-3a1b-4443-b503-20167404c1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d830ee-3a1b-4443-b503-20167404c1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3261d4e4-b193-4979-9eea-6e37cf312794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Volume c5b61536-0367-4edd-b5b5-fb5e105e739f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5b61536-0367-4edd-b5b5-fb5e105e739f', 'volume_size': 1, 'snapshot_id': '2f4bebe9-203b-4a5e-b460-4d6c15f81998'} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-quobyte-2f4bebe9-203b-4a5e-b460-4d6c15f81998-c5b61536-0367-4edd-b5b5-fb5e105e739f" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-2f4bebe9-203b-4a5e-b460-4d6c15f81998-c5b61536-0367-4edd-b5b5-fb5e105e739f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Creating volume c5b61536-0367-4edd-b5b5-fb5e105e739f from snapshot 2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-quobyte-c5b61536-0367-4edd-b5b5-fb5e105e739f" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-c5b61536-0367-4edd-b5b5-fb5e105e739f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] snapshot: 2f4bebe9-203b-4a5e-b460-4d6c15f81998, volume: c5b61536-0367-4edd-b5b5-fb5e105e739f, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9ef50-eb8b-40fa-a6a1-9660ef473d60]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:49 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 Jul 07 17:40:49 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:50 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998" returned: 0 in 0.877s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[44699579-bee0-4510-84ef-0757a1cc43fc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:50 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:40:50 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Flow 'volume_create_manager' (80170489-2469-4731-9601-95913c761b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a45e776-294c-430a-87a4-55df33001048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a45e776-294c-430a-87a4-55df33001048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-132277440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556ee78-2017-4b2a-b320-7e811d51bf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93cf6a7f0c4470aa50f2495188d78d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:51Z,use_quota=True,user_id='c3ac58c0d57f49a7ba22b3f3a61b51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcde3e41-2069-4772-911b-5b8db127004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcde3e41-2069-4772-911b-5b8db127004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3023fd-01a4-4899-be8b-747f1324a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3023fd-01a4-4899-be8b-747f1324a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1556ee78-2017-4b2a-b320-7e811d51bf36', 'volume_name': 'volume-1556ee78-2017-4b2a-b320-7e811d51bf36', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcbc434-670f-4672-84ec-582492d84888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcbc434-670f-4672-84ec-582492d84888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3067023f-265e-496d-94d5-50ae678169d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:50 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Volume 1556ee78-2017-4b2a-b320-7e811d51bf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1556ee78-2017-4b2a-b320-7e811d51bf36', 'volume_size': 1} Jul 07 17:40:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:51 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 0.820s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:51 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:40:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:51 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f Jul 07 17:40:51 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:56 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f" returned: 0 in 4.997s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c5bc2-5829-43d3-b3b0-e50d3d6a2426]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:56 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:40:56 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:57 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 1.131s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:57 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:40:57 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Converted 1024.00 MB image at 204.86 MB/s Jul 07 17:40:57 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f is being set with open permissions: ugo+rw Jul 07 17:40:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:57 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f Jul 07 17:40:57 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:58 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-c5b61536-0367-4edd-b5b5-fb5e105e739f" released by "_copy_volume_from_snapshot" :: held 8.739s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-2f4bebe9-203b-4a5e-b460-4d6c15f81998-c5b61536-0367-4edd-b5b5-fb5e105e739f" released by "_create_volume_from_snapshot" :: held 8.783s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.802s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.439s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-132277440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556ee78-2017-4b2a-b320-7e811d51bf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93cf6a7f0c4470aa50f2495188d78d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:51Z,use_quota=True,user_id='c3ac58c0d57f49a7ba22b3f3a61b51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Creating volume 1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:58 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:58 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 1073741824 Jul 07 17:40:58 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3261d4e4-b193-4979-9eea-6e37cf312794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b61536-0367-4edd-b5b5-fb5e105e739f', 'volume_size': 1, 'snapshot_id': '2f4bebe9-203b-4a5e-b460-4d6c15f81998'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f69714-daca-4aba-93fd-1e100f747094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Volume volume-c5b61536-0367-4edd-b5b5-fb5e105e739f (c5b61536-0367-4edd-b5b5-fb5e105e739f): created successfully Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f69714-daca-4aba-93fd-1e100f747094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Flow 'volume_create_manager' (43bfa4b0-1abd-4757-a8e6-83823af62bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0f5bc36e-af78-4ef9-bd97-7b939b783e97 tempest-TestStampPattern-1415638084 None] Created volume successfully. Jul 07 17:40:59 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 1073741824" returned: 0 in 0.997s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:59 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:40:59 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:00 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.707s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3067023f-265e-496d-94d5-50ae678169d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1556ee78-2017-4b2a-b320-7e811d51bf36', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a1a113-7fe2-4335-b66a-7bd4ec7902e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Volume volume-1556ee78-2017-4b2a-b320-7e811d51bf36 (1556ee78-2017-4b2a-b320-7e811d51bf36): created successfully Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a1a113-7fe2-4335-b66a-7bd4ec7902e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Flow 'volume_create_manager' (80170489-2469-4731-9601-95913c761b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-be902fc3-b924-4f64-9474-9d0b477e62f1 tempest-SnapshotDependencyTests-938381008 None] Created volume successfully. Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Creating offline snapshot 76656862-1974-4a43-8826-1c09ae9ce31e of volume 1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[573bc33c-574c-48af-bdd6-084149552ec8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:00 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:41:00 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:01 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.881s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:01 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e 1G Jul 07 17:41:01 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:02 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e 1G" returned: 0 in 0.843s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1556ee78-2017-4b2a-b320-7e811d51bf36 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:02 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1556ee78-2017-4b2a-b320-7e811d51bf36 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e Jul 07 17:41:02 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:03 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1556ee78-2017-4b2a-b320-7e811d51bf36 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e" returned: 0 in 0.709s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:03 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e is being set with open permissions: ugo+rw Jul 07 17:41:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:03 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e Jul 07 17:41:03 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:03 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e" returned: 0 in 0.729s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:04 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info Jul 07 17:41:04 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:04 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info" returned: 0 in 0.703s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:04 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info is being set with open permissions: ugo+rw Jul 07 17:41:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:04 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info Jul 07 17:41:04 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:05 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.info" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.699s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-28e86254-5311-46d8-bd4c-436d0e1db83b tempest-SnapshotDependencyTests-938381008 None] Create snapshot completed successfully Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Flow 'volume_create_manager' (b8aaa101-5889-440e-82c9-d1f0113e27f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4f1784-377e-4d8f-9049-abadff9ac800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4f1784-377e-4d8f-9049-abadff9ac800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2525fe-4bf0-434e-b614-5975d803b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93cf6a7f0c4470aa50f2495188d78d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=76656862-1974-4a43-8826-1c09ae9ce31e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:07Z,use_quota=True,user_id='c3ac58c0d57f49a7ba22b3f3a61b51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b565d8-f3b4-421d-ac39-0ec960d127ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b565d8-f3b4-421d-ac39-0ec960d127ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f220ce-b011-4605-b487-07a22e70583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f220ce-b011-4605-b487-07a22e70583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f2525fe-4bf0-434e-b614-5975d803b172', 'volume_name': 'volume-5f2525fe-4bf0-434e-b614-5975d803b172', 'volume_size': 1, 'snapshot_id': '76656862-1974-4a43-8826-1c09ae9ce31e'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d76539b-d528-4f4b-aa6f-01af1f0c0d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d76539b-d528-4f4b-aa6f-01af1f0c0d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b1431-9c5f-4e2e-8437-eebde7f298f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Volume 5f2525fe-4bf0-434e-b614-5975d803b172: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f2525fe-4bf0-434e-b614-5975d803b172', 'volume_size': 1, 'snapshot_id': '76656862-1974-4a43-8826-1c09ae9ce31e'} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-quobyte-76656862-1974-4a43-8826-1c09ae9ce31e-5f2525fe-4bf0-434e-b614-5975d803b172" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-76656862-1974-4a43-8826-1c09ae9ce31e-5f2525fe-4bf0-434e-b614-5975d803b172" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Creating volume 5f2525fe-4bf0-434e-b614-5975d803b172 from snapshot 76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-quobyte-5f2525fe-4bf0-434e-b614-5975d803b172" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-5f2525fe-4bf0-434e-b614-5975d803b172" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] snapshot: 76656862-1974-4a43-8826-1c09ae9ce31e, volume: 5f2525fe-4bf0-434e-b614-5975d803b172, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2867a06-ba07-49b6-9dcf-27799ff4fc95]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:07 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e Jul 07 17:41:07 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:07 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e" returned: 0 in 0.883s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1556ee78-2017-4b2a-b320-7e811d51bf36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:41:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:41:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:41:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8442e7-cac7-4b28-801b-894e35e34634]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:08 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:41:08 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:08 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.802s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:08 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:41:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:08 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 Jul 07 17:41:08 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:14 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172" returned: 0 in 5.554s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb35f7-cff6-4678-a3e0-669ed25b3c57]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:14 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:41:14 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:15 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.989s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:15 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:41:15 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Converted 1024.00 MB image at 184.32 MB/s Jul 07 17:41:15 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 is being set with open permissions: ugo+rw Jul 07 17:41:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:15 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 Jul 07 17:41:15 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:16 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172" returned: 0 in 0.739s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-5f2525fe-4bf0-434e-b614-5975d803b172" released by "_copy_volume_from_snapshot" :: held 9.087s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-76656862-1974-4a43-8826-1c09ae9ce31e-5f2525fe-4bf0-434e-b614-5975d803b172" released by "_create_volume_from_snapshot" :: held 9.122s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.140s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b1431-9c5f-4e2e-8437-eebde7f298f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2525fe-4bf0-434e-b614-5975d803b172', 'volume_size': 1, 'snapshot_id': '76656862-1974-4a43-8826-1c09ae9ce31e'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d074121d-7031-45ee-b847-830206603326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:16 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Volume volume-5f2525fe-4bf0-434e-b614-5975d803b172 (5f2525fe-4bf0-434e-b614-5975d803b172): created successfully Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d074121d-7031-45ee-b847-830206603326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Flow 'volume_create_manager' (b8aaa101-5889-440e-82c9-d1f0113e27f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6a89b131-e331-40b0-bc39-11cb4ebc3a26 tempest-SnapshotDependencyTests-938381008 None] Created volume successfully. Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-76656862-1974-4a43-8826-1c09ae9ce31e-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-76656862-1974-4a43-8826-1c09ae9ce31e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-quobyte-1556ee78-2017-4b2a-b320-7e811d51bf36" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-1556ee78-2017-4b2a-b320-7e811d51bf36" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-quobyte-76656862-1974-4a43-8826-1c09ae9ce31e" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-76656862-1974-4a43-8826-1c09ae9ce31e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Deleting offline snapshot 76656862-1974-4a43-8826-1c09ae9ce31e of volume 1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] snapshot_file for this snap is: volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3ac3c-4bd2-4f43-b62a-e6dd69a2e7d4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:16 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e Jul 07 17:41:16 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:17 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e" returned: 0 in 0.754s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1556ee78-2017-4b2a-b320-7e811d51bf36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:41:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb1bd68-4a56-4825-a246-4ca9e2127f85]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:17 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:41:17 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:18 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.740s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:18 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e Jul 07 17:41:18 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e" returned: 0 in 0.725s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:19 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e Jul 07 17:41:19 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36.76656862-1974-4a43-8826-1c09ae9ce31e" returned: 0 in 0.639s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-76656862-1974-4a43-8826-1c09ae9ce31e" released by "_delete_snapshot" :: held 2.964s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-1556ee78-2017-4b2a-b320-7e811d51bf36" released by "delete_snapshot" :: held 2.990s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Created reservations ['5512981d-a8ad-4f4e-b0cc-0a0374498c4c', '22b9b007-af22-4f1e-8e86-e2546b1f4244', '44999d3d-b655-476f-969a-4dc2b10d9a88', 'be43b827-f76c-4f47-b367-321c24b884b5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Delete snapshot completed successfully. Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7705f3cf-c166-47e8-adac-6f5f953b87c7 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-76656862-1974-4a43-8826-1c09ae9ce31e-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-1556ee78-2017-4b2a-b320-7e811d51bf36-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-1556ee78-2017-4b2a-b320-7e811d51bf36-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-quobyte-1556ee78-2017-4b2a-b320-7e811d51bf36" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-1556ee78-2017-4b2a-b320-7e811d51bf36" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f133ab-6c32-4ec7-8d37-faafd706c495]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:20 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:41:20 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:20 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.738s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:20 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36 Jul 07 17:41:20 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:21 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-1556ee78-2017-4b2a-b320-7e811d51bf36" returned: 0 in 0.642s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-1556ee78-2017-4b2a-b320-7e811d51bf36" released by "delete_volume" :: held 1.437s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Created reservations ['e88cc3b7-60d2-440a-b91e-5487cb33c02b', '63ebae91-004d-4463-aa51-8f9c5311c0e9', 'af295505-d7e2-4eeb-8d5c-4d6a7f139d9c', 'cc8364ec-97b6-45ff-be3e-2fa1e5067d5d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:21 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:41:21 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-5f2525fe-4bf0-434e-b614-5975d803b172-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-5f2525fe-4bf0-434e-b614-5975d803b172-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "cinder-quobyte-5f2525fe-4bf0-434e-b614-5975d803b172" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-5f2525fe-4bf0-434e-b614-5975d803b172" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f3088-271d-490d-b71b-2a01e5dd0d51]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:22 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.781s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Deleted volume successfully. Jul 07 17:41:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1dd34da4-d073-4528-9f9c-60275d4a7556 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-1556ee78-2017-4b2a-b320-7e811d51bf36-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:22 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 Jul 07 17:41:22 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:23 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172" returned: 0 in 0.790s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:23 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172 Jul 07 17:41:23 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:23 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5f2525fe-4bf0-434e-b614-5975d803b172" returned: 0 in 0.685s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-quobyte-5f2525fe-4bf0-434e-b614-5975d803b172" released by "delete_volume" :: held 1.522s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Created reservations ['b7c1dda3-aec2-480f-8888-6201e5ca6dbc', 'ebe6e143-65fa-495c-9a96-a7cbae2db12e', 'bea813d6-8983-4484-a37f-0a5df0edb863', 'b159ad1e-3122-4e58-ab7e-214a449001e4'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:23 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:41:23 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:24 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.702s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:24 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Deleted volume successfully. Jul 07 17:41:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b2a5e307-4f73-4d3f-8018-eb547dc7f6e9 tempest-SnapshotDependencyTests-938381008 None] Lock "cinder-5f2525fe-4bf0-434e-b614-5975d803b172-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:32 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:41:32 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:33 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.753s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:41:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:41:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:41:33 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=32,cinder:SELECT=25,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:41:34 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=6 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:41:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3449df65-3fd6-47ca-9df7-b152bb22fa3e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:47 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f Jul 07 17:41:47 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:48 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f" returned: 0 in 0.842s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070', 'name': 'volume-c5b61536-0367-4edd-b5b5-fb5e105e739f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32bd2857-7319-4e89-8a61-f33de56c1ce5', 'enforce_multipath': True} {{(pid=87251) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:41:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-e459bdbb-7368-4f58-ae5b-5e95ea5d04de req-89827233-d90c-48e4-a8a2-2bc745370c3c tempest-TestStampPattern-1415638084 None] attachment_update completed successfully. Jul 07 17:41:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [req-e9a48fd5-6d5c-47ea-9d03-7c12b64c06c4 req-e0f233f3-41d2-4a95-ad1b-96c163f14563 tempest-TestStampPattern-1415638084 None] Terminate volume connection completed successfully. Jul 07 17:41:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [req-e9a48fd5-6d5c-47ea-9d03-7c12b64c06c4 req-e0f233f3-41d2-4a95-ad1b-96c163f14563 tempest-TestStampPattern-1415638084 None] Deleting attachment 32bd2857-7319-4e89-8a61-f33de56c1ce5. {{(pid=87251) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-c5b61536-0367-4edd-b5b5-fb5e105e739f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Lock "cinder-c5b61536-0367-4edd-b5b5-fb5e105e739f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-quobyte-c5b61536-0367-4edd-b5b5-fb5e105e739f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-c5b61536-0367-4edd-b5b5-fb5e105e739f" acquired by "delete_volume" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a140966c-8b19-411b-af27-31cd99c8286a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:05 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f Jul 07 17:42:05 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:06 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f" returned: 0 in 0.773s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:06 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f Jul 07 17:42:06 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:06 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-c5b61536-0367-4edd-b5b5-fb5e105e739f" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-c5b61536-0367-4edd-b5b5-fb5e105e739f" released by "delete_volume" :: held 1.536s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:06 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Created reservations ['6f3111b7-01bf-4ebe-a4bc-c58f47276200', 'ef714981-33d8-44e8-8fb6-de5704117939', '8cbc3670-686f-45ec-8d5e-8ea84adf9c3d', '7835e674-4b3d-414a-84b7-5f6639038834'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:07 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:07 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:07 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.729s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Deleted volume successfully. Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1d6771f4-9645-4bc5-a6f7-a01214654deb tempest-TestStampPattern-1415638084 None] Lock "cinder-c5b61536-0367-4edd-b5b5-fb5e105e739f-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-2f4bebe9-203b-4a5e-b460-4d6c15f81998-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Lock "cinder-2f4bebe9-203b-4a5e-b460-4d6c15f81998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-quobyte-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-quobyte-2f4bebe9-203b-4a5e-b460-4d6c15f81998" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-2f4bebe9-203b-4a5e-b460-4d6c15f81998" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Deleting offline snapshot 2f4bebe9-203b-4a5e-b460-4d6c15f81998 of volume e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] snapshot_file for this snap is: volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:08 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[94295e24-d7dc-4139-8832-076bc3dba6cf]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:08 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 Jul 07 17:42:08 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:08 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998" returned: 0 in 0.828s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:08 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56a0b5-f3aa-4e3f-a2dc-a69c71b39903]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:08 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:42:08 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:09 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 Jul 07 17:42:09 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:10 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998" returned: 0 in 0.820s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:10 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998 Jul 07 17:42:10 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0.2f4bebe9-203b-4a5e-b460-4d6c15f81998" returned: 0 in 0.814s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-2f4bebe9-203b-4a5e-b460-4d6c15f81998" released by "_delete_snapshot" :: held 3.344s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" released by "delete_snapshot" :: held 3.368s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:11 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Created reservations ['f3b94708-1c0b-4d56-b3bc-0c041d75b1a2', 'd7c2cbcd-99e2-412f-ae08-9cd87f3a69a2', '9671cee1-9496-41f4-aefa-1ca15cb2b8ca', '9fbad412-bed9-4d96-8e12-c2597c5e63a5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Delete snapshot completed successfully. Jul 07 17:42:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-521ca00a-ccce-43e5-92ba-aad9f329d202 tempest-TestStampPattern-1415638084 None] Lock "cinder-2f4bebe9-203b-4a5e-b460-4d6c15f81998-delete_snapshot" released by "delete_snapshot" :: held 3.523s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Lock "cinder-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Acquiring lock "cinder-quobyte-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae9f04-234f-4ab9-8d04-504bf11d223c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:20 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:42:20 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:21 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 1.005s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:21 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0 Jul 07 17:42:21 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:22 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" returned: 0 in 0.731s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Lock "cinder-quobyte-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0" released by "delete_volume" :: held 1.803s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Created reservations ['2964876f-2839-4b7b-9584-54d07dcdfe2c', 'a5e3e98c-cdc1-4428-b8f4-a9fb4960a432', '8a0fefbe-a6ba-48c5-ab45-8f511b85e072', '6db0113f-ab57-48b5-a9c5-c06cf45546d5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:22 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:22 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.789s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Deleted volume successfully. Jul 07 17:42:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8117fc7f-68ee-45ab-8a57-e6d9cdd82ad1 tempest-TestStampPattern-1415638084 None] Lock "cinder-e74c4c68-fee5-40be-8f50-fd0a9fe60cb0-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=24,cinder:SELECT=17,cinder:INSERT=5 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:32 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:33 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:33 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.677s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:42:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:42:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (71107ec7-3e76-4e21-82db-c4b8fdca4420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6936a68-fc13-45a8-a58e-49971594ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6936a68-fc13-45a8-a58e-49971594ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360800715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04faa8be-8419-4aec-95cc-e05b4b20890e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:34Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765abe66-bde0-4678-a57a-05a88cf82183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765abe66-bde0-4678-a57a-05a88cf82183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b79d4b-6710-4066-bdf4-61f8079286a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b79d4b-6710-4066-bdf4-61f8079286a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04faa8be-8419-4aec-95cc-e05b4b20890e', 'volume_name': 'volume-04faa8be-8419-4aec-95cc-e05b4b20890e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a973dc9f-627a-4033-8e38-b92ccefb0da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a973dc9f-627a-4033-8e38-b92ccefb0da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a655934f-79fb-402a-95b5-cd5e4147225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Volume 04faa8be-8419-4aec-95cc-e05b4b20890e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04faa8be-8419-4aec-95cc-e05b4b20890e', 'volume_size': 1} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360800715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04faa8be-8419-4aec-95cc-e05b4b20890e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:34Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Creating volume 04faa8be-8419-4aec-95cc-e05b4b20890e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:34 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:34 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e 1073741824 Jul 07 17:42:34 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (a3fd04f9-c234-472e-98ad-46c2e8e1aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15bfcd3-5880-4567-a216-8c1d33008b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15bfcd3-5880-4567-a216-8c1d33008b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234619847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:35Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683c28db-b4e7-45ce-9c55-0de53f26fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683c28db-b4e7-45ce-9c55-0de53f26fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd4965e-1acc-4c6e-8455-a621943c5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd4965e-1acc-4c6e-8455-a621943c5445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d', 'volume_name': 'volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0385e700-bfa8-47cd-89fe-bf738109780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0385e700-bfa8-47cd-89fe-bf738109780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c637b4f9-2476-4512-a46c-7e6363b2b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:34 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Volume a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d', 'volume_size': 1} Jul 07 17:42:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (46436658-dcaf-4487-9db6-d4ee5a3fa89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab253a4-7760-495c-ac21-2c1eb19169c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab253a4-7760-495c-ac21-2c1eb19169c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-31691137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b117773-130c-4f8e-97a5-8bff36d98afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:35Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3ff9ff-5550-4b7d-a6da-8fe891791e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3ff9ff-5550-4b7d-a6da-8fe891791e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22cf46b-0e6f-4212-b20e-b70defbde2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22cf46b-0e6f-4212-b20e-b70defbde2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b117773-130c-4f8e-97a5-8bff36d98afa', 'volume_name': 'volume-2b117773-130c-4f8e-97a5-8bff36d98afa', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17601e99-0872-45fb-a092-be0ed5c6990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17601e99-0872-45fb-a092-be0ed5c6990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef10b3ed-4bde-4163-abb5-7587ec139cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Volume 2b117773-130c-4f8e-97a5-8bff36d98afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b117773-130c-4f8e-97a5-8bff36d98afa', 'volume_size': 1} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:35 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e 1073741824" returned: 0 in 1.120s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (a3a4de99-9673-4ed9-8b04-6ffbea65457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b9bc7-ce12-4a1f-a327-c24affa1e28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b9bc7-ce12-4a1f-a327-c24affa1e28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526653962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41732b46-d091-4db1-94e4-d4905a616c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:36Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b963e038-86b9-4e7e-9363-31f03f6aed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b963e038-86b9-4e7e-9363-31f03f6aed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388b1632-afae-46e2-8a81-ada43b78407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388b1632-afae-46e2-8a81-ada43b78407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41732b46-d091-4db1-94e4-d4905a616c11', 'volume_name': 'volume-41732b46-d091-4db1-94e4-d4905a616c11', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f27df7d-3f87-4353-bc3f-7d183b811a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f27df7d-3f87-4353-bc3f-7d183b811a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164e4f0f-7b99-47fa-8c2f-8780068830a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:35 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Volume 41732b46-d091-4db1-94e4-d4905a616c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41732b46-d091-4db1-94e4-d4905a616c11', 'volume_size': 1} Jul 07 17:42:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (3301526e-53b6-46e5-a519-8b4b72b8adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd286fce-723d-4b32-aba6-eabadc1cd5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd286fce-723d-4b32-aba6-eabadc1cd5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1454721767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0451f413-c518-4abf-8b31-ee7717855292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:36Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038ca3e1-9952-4c73-85a4-b2dab45b7f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038ca3e1-9952-4c73-85a4-b2dab45b7f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e76cacf-3c9f-4de7-b89e-58320fda5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e76cacf-3c9f-4de7-b89e-58320fda5807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0451f413-c518-4abf-8b31-ee7717855292', 'volume_name': 'volume-0451f413-c518-4abf-8b31-ee7717855292', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1110bcc-ebf6-4e1b-bc59-161cbc625dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1110bcc-ebf6-4e1b-bc59-161cbc625dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d99937e-1574-41d8-a16a-9426b8b7d680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Volume 0451f413-c518-4abf-8b31-ee7717855292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0451f413-c518-4abf-8b31-ee7717855292', 'volume_size': 1} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:36 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e" returned: 0 in 0.732s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234619847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:35Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Creating volume a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:36 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a655934f-79fb-402a-95b5-cd5e4147225c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04faa8be-8419-4aec-95cc-e05b4b20890e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2666445-51f9-42e4-a05b-b732082bf71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d 1073741824 Jul 07 17:42:36 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:36 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Volume volume-04faa8be-8419-4aec-95cc-e05b4b20890e (04faa8be-8419-4aec-95cc-e05b4b20890e): created successfully Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2666445-51f9-42e4-a05b-b732082bf71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (71107ec7-3e76-4e21-82db-c4b8fdca4420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:36 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-72a57c99-381c-4304-9d07-8226a36fe878 tempest-CreateVolumesFromImageTest-974192708 None] Created volume successfully. Jul 07 17:42:37 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d 1073741824" returned: 0 in 0.926s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:37 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d Jul 07 17:42:37 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:38 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d" returned: 0 in 0.636s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-31691137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b117773-130c-4f8e-97a5-8bff36d98afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:35Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Creating volume 2b117773-130c-4f8e-97a5-8bff36d98afa {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:38 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:38 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa 1073741824 Jul 07 17:42:38 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c637b4f9-2476-4512-a46c-7e6363b2b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd8c10e-126f-46cc-abbb-22adbc79bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Volume volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d (a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d): created successfully Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd8c10e-126f-46cc-abbb-22adbc79bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (a3fd04f9-c234-472e-98ad-46c2e8e1aa99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:38 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7773424e-3af8-45d0-a59e-58ee99efbfa7 tempest-CreateVolumesFromImageTest-974192708 None] Created volume successfully. Jul 07 17:42:38 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa 1073741824" returned: 0 in 0.836s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:38 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa Jul 07 17:42:38 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:39 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.827s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526653962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41732b46-d091-4db1-94e4-d4905a616c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:36Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Creating volume 41732b46-d091-4db1-94e4-d4905a616c11 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:39 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:39 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 1073741824 Jul 07 17:42:39 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef10b3ed-4bde-4163-abb5-7587ec139cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b117773-130c-4f8e-97a5-8bff36d98afa', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d41438-b53c-4d71-a1c9-12054e8d272b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:39 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Volume volume-2b117773-130c-4f8e-97a5-8bff36d98afa (2b117773-130c-4f8e-97a5-8bff36d98afa): created successfully Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d41438-b53c-4d71-a1c9-12054e8d272b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (46436658-dcaf-4487-9db6-d4ee5a3fa89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1f2cb485-b725-4d40-a7d3-eadf7bf76fb2 tempest-CreateVolumesFromImageTest-974192708 None] Created volume successfully. Jul 07 17:42:40 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 1073741824" returned: 0 in 0.877s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:40 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 Jul 07 17:42:40 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:41 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11" returned: 0 in 0.691s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.042s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1454721767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0451f413-c518-4abf-8b31-ee7717855292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68b7801d06c4c19adc8c8c91bdf90f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:36Z,use_quota=True,user_id='32f0a3c94fe84d5094b475513a5918fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Creating volume 0451f413-c518-4abf-8b31-ee7717855292 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:41 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164e4f0f-7b99-47fa-8c2f-8780068830a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41732b46-d091-4db1-94e4-d4905a616c11', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:41 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 1073741824 Jul 07 17:42:41 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44441eac-a3e4-4abe-bbf5-0415e1df73ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:41 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Volume volume-41732b46-d091-4db1-94e4-d4905a616c11 (41732b46-d091-4db1-94e4-d4905a616c11): created successfully Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44441eac-a3e4-4abe-bbf5-0415e1df73ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:41 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (a3a4de99-9673-4ed9-8b04-6ffbea65457e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-958caf1d-98cd-4382-af64-9c2e705046e6 tempest-CreateVolumesFromImageTest-974192708 None] Created volume successfully. Jul 07 17:42:42 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 1073741824" returned: 0 in 0.922s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:42 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 Jul 07 17:42:42 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:42 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292" returned: 0 in 0.665s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d99937e-1574-41d8-a16a-9426b8b7d680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0451f413-c518-4abf-8b31-ee7717855292', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de28379-54a6-46a0-bb37-4602a5521659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Volume volume-0451f413-c518-4abf-8b31-ee7717855292 (0451f413-c518-4abf-8b31-ee7717855292): created successfully Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de28379-54a6-46a0-bb37-4602a5521659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Flow 'volume_create_manager' (3301526e-53b6-46e5-a519-8b4b72b8adeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1147300f-5069-466a-92ca-de830b7f70e1 tempest-CreateVolumesFromImageTest-974192708 None] Created volume successfully. Jul 07 17:42:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-0451f413-c518-4abf-8b31-ee7717855292-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-0451f413-c518-4abf-8b31-ee7717855292-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-quobyte-0451f413-c518-4abf-8b31-ee7717855292" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-0451f413-c518-4abf-8b31-ee7717855292" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f451306-6136-4c6f-a79b-fbc225f134d7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:43 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 Jul 07 17:42:43 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:44 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292" returned: 0 in 0.797s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:44 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292 Jul 07 17:42:44 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:45 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0451f413-c518-4abf-8b31-ee7717855292" returned: 0 in 0.676s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-0451f413-c518-4abf-8b31-ee7717855292" released by "delete_volume" :: held 1.515s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Created reservations ['1befade9-81c8-4689-830b-5443b8dda9e6', '54c42fef-a4a3-487f-b4cf-e340593b7f75', 'cbc8356e-b85f-472f-bc4b-38a31b2a4152', 'b8160773-ad91-4bc0-9199-a1b0bcc82456'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:45 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:45 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-41732b46-d091-4db1-94e4-d4905a616c11-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-41732b46-d091-4db1-94e4-d4905a616c11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-quobyte-41732b46-d091-4db1-94e4-d4905a616c11" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-41732b46-d091-4db1-94e4-d4905a616c11" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f93a0a-28ae-4b48-9dc3-8e2872bb01f5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:46 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.710s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Deleted volume successfully. Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-77b5f593-dc10-45f7-85d2-6ec9d02eaca7 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-0451f413-c518-4abf-8b31-ee7717855292-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:46 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 Jul 07 17:42:46 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:46 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11" returned: 0 in 0.756s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:46 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11 Jul 07 17:42:46 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:47 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-41732b46-d091-4db1-94e4-d4905a616c11" returned: 0 in 0.662s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-41732b46-d091-4db1-94e4-d4905a616c11" released by "delete_volume" :: held 1.480s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Created reservations ['982416f4-8e97-4a0f-8edb-abc2d81038d7', '1becd8a3-f65f-403b-9be8-bef6b4c25d11', '30fa79da-d7b0-4b53-95d9-7a292bde4a38', 'd57b8279-7349-496b-9122-c6e5816378c7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:47 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:47 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-2b117773-130c-4f8e-97a5-8bff36d98afa-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-2b117773-130c-4f8e-97a5-8bff36d98afa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-quobyte-2b117773-130c-4f8e-97a5-8bff36d98afa" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-2b117773-130c-4f8e-97a5-8bff36d98afa" acquired by "delete_volume" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cb0a77-6f51-451a-9e43-c9858ec20e07]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:48 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.684s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Deleted volume successfully. Jul 07 17:42:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7cc6c632-dd71-4430-969c-99c267a9da45 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-41732b46-d091-4db1-94e4-d4905a616c11-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:48 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa Jul 07 17:42:48 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:49 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa" returned: 0 in 0.788s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:49 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa Jul 07 17:42:49 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:49 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2b117773-130c-4f8e-97a5-8bff36d98afa" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-2b117773-130c-4f8e-97a5-8bff36d98afa" released by "delete_volume" :: held 1.492s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Created reservations ['d38c4814-bcad-4c74-9816-94064b2d6ad1', 'd1fcdfdc-922a-4971-bdf2-5a40dba0148a', 'c61c94e4-de70-46e5-a070-8bace6490fc9', '8add45ff-a1ea-44b5-bfba-8e6879397f7a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:49 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:49 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-quobyte-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe84a320-93e0-4584-b9c1-1ee2002af3aa]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:50 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.747s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Deleted volume successfully. Jul 07 17:42:50 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ccd9ea5a-293b-4885-9ab1-3f49004b9da4 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-2b117773-130c-4f8e-97a5-8bff36d98afa-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:50 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d Jul 07 17:42:50 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d" returned: 0 in 0.802s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:51 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d Jul 07 17:42:51 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d" returned: 0 in 0.661s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d" released by "delete_volume" :: held 1.509s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Created reservations ['2f949616-99e3-43cc-990f-eb8b3d9da7f2', '0a1d084c-f85b-4e33-8da1-2bba079d2f5d', '03f026ac-5110-48df-8d3f-784dff4cdc7f', '432d5210-10c8-47b2-a799-8d83412d62e2'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:52 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-04faa8be-8419-4aec-95cc-e05b4b20890e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-04faa8be-8419-4aec-95cc-e05b4b20890e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "cinder-quobyte-04faa8be-8419-4aec-95cc-e05b4b20890e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-04faa8be-8419-4aec-95cc-e05b4b20890e" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[034fb72f-e384-4d7a-b1fb-5791378d68d1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.738s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:52 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Deleted volume successfully. Jul 07 17:42:52 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e Jul 07 17:42:52 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-a54e395b-604d-45ae-bcc2-e84e6c143440 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-a0cc0dfd-50fa-43d0-b0c5-a95d83f4798d-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:53 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e" returned: 0 in 0.758s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:53 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e Jul 07 17:42:53 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:54 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-04faa8be-8419-4aec-95cc-e05b4b20890e" returned: 0 in 0.639s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-quobyte-04faa8be-8419-4aec-95cc-e05b4b20890e" released by "delete_volume" :: held 1.445s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Created reservations ['d69ec52d-efa7-48b6-8fbc-2757d48c9292', '63edefde-e9f5-4126-826d-5543055b7708', '0d0ce85b-1f5c-4cf7-baea-786bc08c0d22', '1d5f915b-7724-46a7-92ba-0ca2af952322'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:54 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:42:54 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:55 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.657s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:55 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Deleted volume successfully. Jul 07 17:42:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b3abfa02-e6fb-450f-898c-00ad55c9b038 tempest-CreateVolumesFromImageTest-974192708 None] Lock "cinder-04faa8be-8419-4aec-95cc-e05b4b20890e-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (a94c9a99-f6cb-47ec-9423-ac3fc0c0a57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf77afdb-a746-41f4-ae39-ac06c09d0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf77afdb-a746-41f4-ae39-ac06c09d0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118539560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c4e4e2-8334-4e9d-bf04-64d922defed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:58Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960e29a7-eb08-4890-959a-f82caaa9cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960e29a7-eb08-4890-959a-f82caaa9cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fce47a-a2f1-46b1-a867-61b8fb339abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fce47a-a2f1-46b1-a867-61b8fb339abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c4e4e2-8334-4e9d-bf04-64d922defed7', 'volume_name': 'volume-72c4e4e2-8334-4e9d-bf04-64d922defed7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bb75aa-43bd-4c54-9a28-ee517bd09de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bb75aa-43bd-4c54-9a28-ee517bd09de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa6b415-0441-4156-95f2-9a06eee14197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume 72c4e4e2-8334-4e9d-bf04-64d922defed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c4e4e2-8334-4e9d-bf04-64d922defed7', 'volume_size': 1} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118539560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c4e4e2-8334-4e9d-bf04-64d922defed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:58Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Creating volume 72c4e4e2-8334-4e9d-bf04-64d922defed7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:58 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:42:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:58 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 1073741824 Jul 07 17:42:58 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:59 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 1073741824" returned: 0 in 0.973s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:59 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 Jul 07 17:42:59 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:59 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7" returned: 0 in 0.674s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa6b415-0441-4156-95f2-9a06eee14197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c4e4e2-8334-4e9d-bf04-64d922defed7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543e4946-b1a8-495c-b283-f06364531549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 (72c4e4e2-8334-4e9d-bf04-64d922defed7): created successfully Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543e4946-b1a8-495c-b283-f06364531549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (a94c9a99-f6cb-47ec-9423-ac3fc0c0a57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bae75a2a-9ad1-4d3f-8efa-241071d158a0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created volume successfully. Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (dd0fced9-d62e-45d0-8401-d681dbc19151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3245c2d1-d893-4a70-b84f-f02172dd9ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3245c2d1-d893-4a70-b84f-f02172dd9ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496615463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b530ad-1afa-4f5c-8829-72b0cd7870c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:01Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8060e7-5adc-4be6-b1d5-688bb28c7ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8060e7-5adc-4be6-b1d5-688bb28c7ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe24c87-1bb3-4832-bcf0-0f53ce047a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe24c87-1bb3-4832-bcf0-0f53ce047a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b530ad-1afa-4f5c-8829-72b0cd7870c6', 'volume_name': 'volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb25b29d-9448-4126-a949-77f3bdf102df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb25b29d-9448-4126-a949-77f3bdf102df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd55ac9-54b2-494d-973f-cd00d12e88e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume 23b530ad-1afa-4f5c-8829-72b0cd7870c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6', 'volume_size': 1} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496615463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b530ad-1afa-4f5c-8829-72b0cd7870c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:01Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Creating volume 23b530ad-1afa-4f5c-8829-72b0cd7870c6 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:00 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 1073741824 Jul 07 17:43:00 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (a839901b-1e45-47c5-8aa4-c7b59645d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8842122-03ed-42d8-93e8-ecef54bfeb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8842122-03ed-42d8-93e8-ecef54bfeb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962562974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8df8e4d-f479-43a4-818c-bc8971051e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:01Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a64abed-b256-4aca-944a-d0e1ad2d568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a64abed-b256-4aca-944a-d0e1ad2d568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b146a6c-dc2f-46f0-8263-3cbb45eddcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b146a6c-dc2f-46f0-8263-3cbb45eddcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8df8e4d-f479-43a4-818c-bc8971051e55', 'volume_name': 'volume-e8df8e4d-f479-43a4-818c-bc8971051e55', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e82d8e5-f9ed-4524-bb8b-fc5dcc223fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e82d8e5-f9ed-4524-bb8b-fc5dcc223fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04724ce8-1d07-402f-b0f9-0a7ab8698960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume e8df8e4d-f479-43a4-818c-bc8971051e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8df8e4d-f479-43a4-818c-bc8971051e55', 'volume_size': 1} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (bc04c905-7362-411f-b8f4-300f6027163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dada7c3-7a24-439c-9ad7-6016336206fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dada7c3-7a24-439c-9ad7-6016336206fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079962603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48797383-b4b2-4d43-ab1a-f21f785df94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:02Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d018d1-2350-4632-a99d-1f7f68fa7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d018d1-2350-4632-a99d-1f7f68fa7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10720dec-d002-4579-a613-3347379043cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10720dec-d002-4579-a613-3347379043cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48797383-b4b2-4d43-ab1a-f21f785df94f', 'volume_name': 'volume-48797383-b4b2-4d43-ab1a-f21f785df94f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba391712-6205-4b3b-a9cd-dcb5b4688f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba391712-6205-4b3b-a9cd-dcb5b4688f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a660a03-1568-4422-b2a4-8a075a0eb227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume 48797383-b4b2-4d43-ab1a-f21f785df94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48797383-b4b2-4d43-ab1a-f21f785df94f', 'volume_size': 1} Jul 07 17:43:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:02 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 1073741824" returned: 0 in 1.136s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (23721a9a-96d1-47bd-aca3-cc2756e5229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c937b9b-423d-465b-a31e-05c2de635768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c937b9b-423d-465b-a31e-05c2de635768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056691049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984d3642-fa6a-4a65-92be-a1b671f04fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:02Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 Jul 07 17:43:02 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed086ea-5543-4094-8753-3fc0b2df5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed086ea-5543-4094-8753-3fc0b2df5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9d0465-787d-488c-b215-f0348a51211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9d0465-787d-488c-b215-f0348a51211c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984d3642-fa6a-4a65-92be-a1b671f04fbe', 'volume_name': 'volume-984d3642-fa6a-4a65-92be-a1b671f04fbe', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342af9f9-3819-4d7f-a13d-afb2f73ce66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342af9f9-3819-4d7f-a13d-afb2f73ce66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f309a0c-51ef-4c62-9956-202cb7ca8104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume 984d3642-fa6a-4a65-92be-a1b671f04fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984d3642-fa6a-4a65-92be-a1b671f04fbe', 'volume_size': 1} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (80adaec0-cd73-4816-9334-22216c98f0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbcd74f-c2f3-4d3e-8677-ce5d241f7064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbcd74f-c2f3-4d3e-8677-ce5d241f7064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909670666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a5137b-43ff-4e4b-b562-6f0d1467bb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:03Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df78623-d821-4a45-a263-4e2418dafd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df78623-d821-4a45-a263-4e2418dafd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501b903e-4b6b-4cba-8126-e82c881bf17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501b903e-4b6b-4cba-8126-e82c881bf17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a5137b-43ff-4e4b-b562-6f0d1467bb9f', 'volume_name': 'volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc82f70-5630-4859-aacc-9c728a2f2d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc82f70-5630-4859-aacc-9c728a2f2d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f8568f-232e-4ae0-b75a-d3f1c558bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume 12a5137b-43ff-4e4b-b562-6f0d1467bb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f', 'volume_size': 1} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:02 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6" returned: 0 in 0.761s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962562974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8df8e4d-f479-43a4-818c-bc8971051e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:01Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Creating volume e8df8e4d-f479-43a4-818c-bc8971051e55 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:02 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd55ac9-54b2-494d-973f-cd00d12e88e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:02 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 1073741824 Jul 07 17:43:02 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd55461e-936c-4785-841d-47cc132d3cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:03 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 (23b530ad-1afa-4f5c-8829-72b0cd7870c6): created successfully Jul 07 17:43:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd55461e-936c-4785-841d-47cc132d3cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (dd0fced9-d62e-45d0-8401-d681dbc19151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:03 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-da2c52bf-53f8-419c-acac-aa986ae929b4 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created volume successfully. Jul 07 17:43:03 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 1073741824" returned: 0 in 1.012s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:04 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 Jul 07 17:43:04 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079962603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48797383-b4b2-4d43-ab1a-f21f785df94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:02Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Creating volume 48797383-b4b2-4d43-ab1a-f21f785df94f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:04 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:04 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f 1073741824 Jul 07 17:43:04 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04724ce8-1d07-402f-b0f9-0a7ab8698960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8df8e4d-f479-43a4-818c-bc8971051e55', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfac0567-d7ce-4f93-89d4-63e8f5e416d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:04 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume volume-e8df8e4d-f479-43a4-818c-bc8971051e55 (e8df8e4d-f479-43a4-818c-bc8971051e55): created successfully Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfac0567-d7ce-4f93-89d4-63e8f5e416d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (a839901b-1e45-47c5-8aa4-c7b59645d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6b72376f-8046-4775-a2f7-960542a10913 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created volume successfully. Jul 07 17:43:05 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f 1073741824" returned: 0 in 0.920s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:05 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f Jul 07 17:43:05 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:06 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f" returned: 0 in 0.728s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.253s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056691049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984d3642-fa6a-4a65-92be-a1b671f04fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:02Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Creating volume 984d3642-fa6a-4a65-92be-a1b671f04fbe {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:06 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe 1073741824 Jul 07 17:43:06 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a660a03-1568-4422-b2a4-8a075a0eb227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48797383-b4b2-4d43-ab1a-f21f785df94f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f056abb2-b41c-4988-8520-c1007a9365e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:06 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume volume-48797383-b4b2-4d43-ab1a-f21f785df94f (48797383-b4b2-4d43-ab1a-f21f785df94f): created successfully Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f056abb2-b41c-4988-8520-c1007a9365e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (bc04c905-7362-411f-b8f4-300f6027163d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-771e6ec8-8888-4469-8f90-50cce30114fe tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created volume successfully. Jul 07 17:43:07 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe 1073741824" returned: 0 in 0.949s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:07 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe Jul 07 17:43:07 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:08 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe" returned: 0 in 0.707s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.570s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909670666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a5137b-43ff-4e4b-b562-6f0d1467bb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd40bccb837944cfb908bd11d918838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:03Z,use_quota=True,user_id='15c0a4248b754ab2a2008f617e0f8ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Creating volume 12a5137b-43ff-4e4b-b562-6f0d1467bb9f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:08 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f309a0c-51ef-4c62-9956-202cb7ca8104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984d3642-fa6a-4a65-92be-a1b671f04fbe', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f590e224-0617-483c-9435-7f82a460a111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f 1073741824 Jul 07 17:43:08 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume volume-984d3642-fa6a-4a65-92be-a1b671f04fbe (984d3642-fa6a-4a65-92be-a1b671f04fbe): created successfully Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f590e224-0617-483c-9435-7f82a460a111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (23721a9a-96d1-47bd-aca3-cc2756e5229d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3d27d4f4-2953-40c7-aa85-066dd3a49719 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created volume successfully. Jul 07 17:43:09 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f 1073741824" returned: 0 in 0.885s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:09 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f Jul 07 17:43:09 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:09 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f" returned: 0 in 0.631s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f8568f-232e-4ae0-b75a-d3f1c558bec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81c8e0b-79f6-4468-b678-08db0907eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Volume volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f (12a5137b-43ff-4e4b-b562-6f0d1467bb9f): created successfully Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81c8e0b-79f6-4468-b678-08db0907eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Flow 'volume_create_manager' (80adaec0-cd73-4816-9334-22216c98f0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a3ee8b98-2c2e-4b62-a109-c2ce1b147309 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created volume successfully. Jul 07 17:43:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-12a5137b-43ff-4e4b-b562-6f0d1467bb9f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-12a5137b-43ff-4e4b-b562-6f0d1467bb9f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-quobyte-12a5137b-43ff-4e4b-b562-6f0d1467bb9f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-12a5137b-43ff-4e4b-b562-6f0d1467bb9f" acquired by "delete_volume" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4716bf-7b07-49a8-927e-63c01c82d83a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:10 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f Jul 07 17:43:10 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:11 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f Jul 07 17:43:11 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-12a5137b-43ff-4e4b-b562-6f0d1467bb9f" returned: 0 in 0.642s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-12a5137b-43ff-4e4b-b562-6f0d1467bb9f" released by "delete_volume" :: held 1.469s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:11 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created reservations ['d081a861-1f09-4f67-81e4-f6b335918325', '90d3acb5-5215-4121-bf6e-0fc309a9e2bc', '434ea4bc-86b7-4228-87d2-aa6cd5401ad0', '774cb22c-e9c7-4759-9c26-9c47f0f0bdf1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:12 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:12 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-984d3642-fa6a-4a65-92be-a1b671f04fbe-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-984d3642-fa6a-4a65-92be-a1b671f04fbe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-quobyte-984d3642-fa6a-4a65-92be-a1b671f04fbe" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-984d3642-fa6a-4a65-92be-a1b671f04fbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f42953-eae9-4202-9dbd-ed4050cd40f1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:12 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.718s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:12 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Deleted volume successfully. Jul 07 17:43:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-127f4988-ebd6-4d49-b2bc-5320c7f235a5 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-12a5137b-43ff-4e4b-b562-6f0d1467bb9f-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:12 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe Jul 07 17:43:12 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:13 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe" returned: 0 in 0.821s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:13 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe Jul 07 17:43:13 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:14 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-984d3642-fa6a-4a65-92be-a1b671f04fbe" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-984d3642-fa6a-4a65-92be-a1b671f04fbe" released by "delete_volume" :: held 1.592s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created reservations ['69745147-9f6f-4196-8afb-2504e7316b25', '4915500d-01f0-44cb-95e3-c9125dc212e5', 'a8af36f9-a61b-438d-a438-265794f3bee1', 'fbd5b4e5-93a1-4370-870a-53045ca0afdc'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:14 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:14 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-48797383-b4b2-4d43-ab1a-f21f785df94f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-48797383-b4b2-4d43-ab1a-f21f785df94f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-quobyte-48797383-b4b2-4d43-ab1a-f21f785df94f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-48797383-b4b2-4d43-ab1a-f21f785df94f" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[84577e3d-d8fe-4535-b9f3-a8a454d00e51]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:15 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f Jul 07 17:43:15 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:15 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.753s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:15 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Deleted volume successfully. Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5a993534-fbf2-4ae8-80ac-2d644621f63e tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-984d3642-fa6a-4a65-92be-a1b671f04fbe-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:15 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f" returned: 0 in 0.855s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:15 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f Jul 07 17:43:15 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:16 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-48797383-b4b2-4d43-ab1a-f21f785df94f" returned: 0 in 0.799s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-48797383-b4b2-4d43-ab1a-f21f785df94f" released by "delete_volume" :: held 1.707s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created reservations ['a1a3a618-b588-4df2-995a-e0672d35a9f2', '8dbe6de0-1e99-4a06-9f98-7b4d8778fd7c', '7b25b6cb-b366-454a-84bb-d1a977b618f0', '85cf332f-8932-4f31-95c6-207635fa5c70'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:16 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:16 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-e8df8e4d-f479-43a4-818c-bc8971051e55-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-e8df8e4d-f479-43a4-818c-bc8971051e55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-quobyte-e8df8e4d-f479-43a4-818c-bc8971051e55" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-e8df8e4d-f479-43a4-818c-bc8971051e55" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7f4d9-103e-49f6-ba25-68c1b7e5c4e2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:17 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 Jul 07 17:43:17 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.710s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Deleted volume successfully. Jul 07 17:43:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-056d5142-3643-404b-a9a9-966c6fdbd0ef tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-48797383-b4b2-4d43-ab1a-f21f785df94f-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:18 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55 Jul 07 17:43:18 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:18 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8df8e4d-f479-43a4-818c-bc8971051e55" returned: 0 in 0.670s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-e8df8e4d-f479-43a4-818c-bc8971051e55" released by "delete_volume" :: held 1.500s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created reservations ['c5ba0d19-6631-4e90-905a-c9a2d1e77d31', '581488ba-67fb-48f9-9ad2-70082f044270', '075165bc-1fc5-48ab-84fd-2cc07736c4fb', 'bb9af57e-b961-493b-ba45-658007610294'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:18 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-23b530ad-1afa-4f5c-8829-72b0cd7870c6-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-23b530ad-1afa-4f5c-8829-72b0cd7870c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-quobyte-23b530ad-1afa-4f5c-8829-72b0cd7870c6" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-23b530ad-1afa-4f5c-8829-72b0cd7870c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e650aa8d-0045-4436-aeaf-f1de11b2cd09]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:19 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.711s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Deleted volume successfully. Jul 07 17:43:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c6ca12d9-700e-48a4-a685-c7a1efe98bd0 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-e8df8e4d-f479-43a4-818c-bc8971051e55-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:19 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 Jul 07 17:43:19 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6" returned: 0 in 0.836s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:20 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6 Jul 07 17:43:20 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-23b530ad-1afa-4f5c-8829-72b0cd7870c6" returned: 0 in 0.660s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-23b530ad-1afa-4f5c-8829-72b0cd7870c6" released by "delete_volume" :: held 1.536s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created reservations ['02f11eb0-3974-4aff-b5b3-217a6c1f184a', 'cbcc04c1-46af-48fd-8cba-1d3fc67efcc6', '3873ac47-5e5f-453b-b9c1-cd53e86d247d', '4342d4c4-91ab-4b18-a17d-419d7767b15b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:21 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:21 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-72c4e4e2-8334-4e9d-bf04-64d922defed7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-72c4e4e2-8334-4e9d-bf04-64d922defed7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "cinder-quobyte-72c4e4e2-8334-4e9d-bf04-64d922defed7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-72c4e4e2-8334-4e9d-bf04-64d922defed7" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1fbc06-3a3d-4d44-b6db-d46cf6b85cc0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:21 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 Jul 07 17:43:21 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:22 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Deleted volume successfully. Jul 07 17:43:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-b9558d26-4841-4e70-ba25-6174966b88cb tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-23b530ad-1afa-4f5c-8829-72b0cd7870c6-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:22 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7" returned: 0 in 0.796s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:22 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7 Jul 07 17:43:22 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:23 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-72c4e4e2-8334-4e9d-bf04-64d922defed7" returned: 0 in 0.693s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-quobyte-72c4e4e2-8334-4e9d-bf04-64d922defed7" released by "delete_volume" :: held 1.540s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Created reservations ['699e4204-e446-4f4c-a7ea-206e5c565a29', '90a74fa5-d344-4b68-bdb2-86ea8bb828c5', '52c16dac-760c-43e6-814e-d94320f54321', '9587e62d-cf2a-4668-85ed-3c82c91bbad0'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:23 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:23 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:24 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.691s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:24 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Deleted volume successfully. Jul 07 17:43:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-672143bf-f81b-4b5e-befa-80d914443154 tempest-CreateVolumesFromSourceVolumeTest-468313417 None] Lock "cinder-72c4e4e2-8334-4e9d-bf04-64d922defed7-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Flow 'volume_create_manager' (525bf09d-3002-434c-944f-f7894e78689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3ed402-b9a8-4edb-9f62-0c6a46a2583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3ed402-b9a8-4edb-9f62-0c6a46a2583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508573921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31ca687-4062-4e3d-9aeb-a3cf5378bf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd93dac698a4f8c8fc7a36015c051a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:28Z,use_quota=True,user_id='b20affb21f4a4c11aaf6d9992a74e8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0388ed8b-6e90-44e5-858d-8a9c073e6f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0388ed8b-6e90-44e5-858d-8a9c073e6f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7711ea73-94e9-493b-b65d-6b08263aacd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7711ea73-94e9-493b-b65d-6b08263aacd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31ca687-4062-4e3d-9aeb-a3cf5378bf5c', 'volume_name': 'volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676cd979-ade2-4cbf-96e2-595f4b7658ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676cd979-ade2-4cbf-96e2-595f4b7658ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd0e500-4287-4e15-a97d-875111f2e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:27 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Volume a31ca687-4062-4e3d-9aeb-a3cf5378bf5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c', 'volume_size': 1} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508573921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31ca687-4062-4e3d-9aeb-a3cf5378bf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd93dac698a4f8c8fc7a36015c051a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:28Z,use_quota=True,user_id='b20affb21f4a4c11aaf6d9992a74e8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Creating volume a31ca687-4062-4e3d-9aeb-a3cf5378bf5c {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:27 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:27 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c 1073741824 Jul 07 17:43:27 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c 1073741824" returned: 0 in 0.971s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:28 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c Jul 07 17:43:28 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:29 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c" returned: 0 in 0.694s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd0e500-4287-4e15-a97d-875111f2e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1aa687-dc22-4480-821e-eac5a1161092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:29 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Volume volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c (a31ca687-4062-4e3d-9aeb-a3cf5378bf5c): created successfully Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1aa687-dc22-4480-821e-eac5a1161092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Flow 'volume_create_manager' (525bf09d-3002-434c-944f-f7894e78689f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-890ede1c-abb2-4294-b497-74aef365e259 tempest-ProjectReaderTests-98727423 None] Created volume successfully. Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Acquiring lock "cinder-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Lock "cinder-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Acquiring lock "cinder-quobyte-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Lock "cinder-quobyte-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f8f7b-0132-44a8-9a46-3a285a0ea1db]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:30 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c Jul 07 17:43:30 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:30 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c" returned: 0 in 0.758s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:30 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c Jul 07 17:43:30 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:31 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c" returned: 0 in 0.638s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Lock "cinder-quobyte-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c" released by "delete_volume" :: held 1.438s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Created reservations ['c93e8879-267d-4a23-95f8-419c3126aceb', '94c8ebd1-5ebc-4350-b3b5-9da33eb88084', '24bb4913-e1c3-4b99-92c1-554d0fa20b14', '010bda36-0601-4077-b52d-b1fc36f959a9'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:31 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:31 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:32 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.675s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Deleted volume successfully. Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d900d2fd-abfe-4b70-a51a-d6dd5ca049be tempest-ProjectReaderTests-98727423 None] Lock "cinder-a31ca687-4062-4e3d-9aeb-a3cf5378bf5c-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Flow 'volume_create_manager' (e34aadc7-1639-45b0-9eaf-aa3ab3451b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5355c553-9159-406f-87e0-bd6e03c9c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=83,cinder:UPDATE=134,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5355c553-9159-406f-87e0-bd6e03c9c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-27808938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe20268d-6da5-4b18-91fa-d9c10e40c73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd93dac698a4f8c8fc7a36015c051a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:33Z,use_quota=True,user_id='b20affb21f4a4c11aaf6d9992a74e8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a851e1-4034-421c-b99c-5906ae8f479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a851e1-4034-421c-b99c-5906ae8f479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a67d5fd-90f7-4c23-945f-0c82254dee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a67d5fd-90f7-4c23-945f-0c82254dee9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe20268d-6da5-4b18-91fa-d9c10e40c73a', 'volume_name': 'volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfd52db-6812-48ea-89e9-934ca4c8121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfd52db-6812-48ea-89e9-934ca4c8121d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b50a54-15d2-4610-ad8f-382e14d4ef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:32 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Volume fe20268d-6da5-4b18-91fa-d9c10e40c73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a', 'volume_size': 1} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-27808938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe20268d-6da5-4b18-91fa-d9c10e40c73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd93dac698a4f8c8fc7a36015c051a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:33Z,use_quota=True,user_id='b20affb21f4a4c11aaf6d9992a74e8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Creating volume fe20268d-6da5-4b18-91fa-d9c10e40c73a {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:32 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:32 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a 1073741824 Jul 07 17:43:32 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:32 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:32 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:33 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.700s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:43:33 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a 1073741824" returned: 0 in 0.878s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=88,cinder:UPDATE=131,cinder:DELETE=15,cinder:INSERT=33 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:33 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a Jul 07 17:43:33 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:34 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a" returned: 0 in 0.625s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b50a54-15d2-4610-ad8f-382e14d4ef98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed492a63-126b-4c73-86c1-219bf75002a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:34 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Volume volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a (fe20268d-6da5-4b18-91fa-d9c10e40c73a): created successfully Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed492a63-126b-4c73-86c1-219bf75002a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Flow 'volume_create_manager' (e34aadc7-1639-45b0-9eaf-aa3ab3451b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-31db2047-5bc3-4dbf-98a2-a76141db3b5a tempest-ProjectReaderTests-98727423 None] Created volume successfully. Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Acquiring lock "cinder-fe20268d-6da5-4b18-91fa-d9c10e40c73a-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Lock "cinder-fe20268d-6da5-4b18-91fa-d9c10e40c73a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Acquiring lock "cinder-quobyte-fe20268d-6da5-4b18-91fa-d9c10e40c73a" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Lock "cinder-quobyte-fe20268d-6da5-4b18-91fa-d9c10e40c73a" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf05c1b-7075-463c-85c1-2d1c37c2c412]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:34 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a Jul 07 17:43:34 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:35 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a" returned: 0 in 0.785s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:35 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a Jul 07 17:43:35 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-fe20268d-6da5-4b18-91fa-d9c10e40c73a" returned: 0 in 0.653s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Lock "cinder-quobyte-fe20268d-6da5-4b18-91fa-d9c10e40c73a" released by "delete_volume" :: held 1.478s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Created reservations ['5cfd58aa-6e76-4462-9d02-a0cb128ada67', 'a7e8d17e-fc2b-456b-8539-f373e40e0f31', '82266413-ba4a-4a2d-8bfc-f84146da678f', '5733202e-10ce-47be-a736-94bb3c054c6b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:43:36 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:37 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.658s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:37 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Deleted volume successfully. Jul 07 17:43:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c012a414-28dd-46ad-8efa-ceb7cd38227f tempest-ProjectReaderTests-98727423 None] Lock "cinder-fe20268d-6da5-4b18-91fa-d9c10e40c73a-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:46 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:INSERT=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:47 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (dd0b4e7a-6e94-4796-bc34-ac27a562adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d8d13-e46b-4b42-bb8e-1a1c52a3247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d8d13-e46b-4b42-bb8e-1a1c52a3247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1464390910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a2e4ab-53b2-42e7-98d2-05f1e3678718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:54Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed18bdc0-74d3-406e-bbab-3e57bb09a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed18bdc0-74d3-406e-bbab-3e57bb09a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e11e4bb-f3be-4545-a6cd-380366e362de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e11e4bb-f3be-4545-a6cd-380366e362de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a2e4ab-53b2-42e7-98d2-05f1e3678718', 'volume_name': 'volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c66a23-3457-48de-bfb3-6a0afd4169df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c66a23-3457-48de-bfb3-6a0afd4169df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91012609-df9c-4b1b-9fc2-579d69a6c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:53 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume e7a2e4ab-53b2-42e7-98d2-05f1e3678718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718', 'volume_size': 1} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1464390910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a2e4ab-53b2-42e7-98d2-05f1e3678718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:54Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Creating volume e7a2e4ab-53b2-42e7-98d2-05f1e3678718 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:53 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:53 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 1073741824 Jul 07 17:43:53 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (4871c7f3-b522-4cb0-9c3e-b10fbbf87fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b881e429-beb8-4e8c-a245-74983fa38166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b881e429-beb8-4e8c-a245-74983fa38166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-994246721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e48c5a8-71f4-4360-bb7a-9f9353a28ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:54Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb807fd-9e0f-43e7-bc16-8fd4d844b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb807fd-9e0f-43e7-bc16-8fd4d844b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5c305b-ff73-4e0f-9530-9deea11b43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5c305b-ff73-4e0f-9530-9deea11b43b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e48c5a8-71f4-4360-bb7a-9f9353a28ec8', 'volume_name': 'volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f2ee6a-e2cb-41f2-9be2-0fb3d2d55027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f2ee6a-e2cb-41f2-9be2-0fb3d2d55027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d76bced-f5d9-422b-9cfe-a9d9c113bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Volume 6e48c5a8-71f4-4360-bb7a-9f9353a28ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8', 'volume_size': 1} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Flow 'volume_create_manager' (2b3b2c91-1e26-4670-8965-bb6fc0b9d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4404c37a-f059-4137-934f-b1187bacfe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4404c37a-f059-4137-934f-b1187bacfe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1847416480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d1e32e-8108-4f13-9601-fc51061e1b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a0eee1f24c40e3bfd07b2ff43579d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='7227acc9393c4d5ca895fec90fd2c0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036d0d82-ad36-4728-b8cc-fd2eedaaf666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036d0d82-ad36-4728-b8cc-fd2eedaaf666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dad969-8485-4052-904a-999a7e9a1b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dad969-8485-4052-904a-999a7e9a1b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d1e32e-8108-4f13-9601-fc51061e1b0c', 'volume_name': 'volume-18d1e32e-8108-4f13-9601-fc51061e1b0c', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c11923a-8479-470a-ba85-38b618881609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c11923a-8479-470a-ba85-38b618881609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc59d8d1-c6dd-48b3-80e5-39e12b9536c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Volume 18d1e32e-8108-4f13-9601-fc51061e1b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d1e32e-8108-4f13-9601-fc51061e1b0c', 'volume_size': 1} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (d481456d-1c99-4809-8da0-253c9bd272e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259e97c5-6d47-447d-8452-6e65b0a4ff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259e97c5-6d47-447d-8452-6e65b0a4ff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440087852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bbf783-86d7-4130-abec-99400d4028ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d38c2f-4af0-4352-ab66-b58ddbd74532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d38c2f-4af0-4352-ab66-b58ddbd74532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ab66c3-9038-4619-b1ab-9c0defc62551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ab66c3-9038-4619-b1ab-9c0defc62551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bbf783-86d7-4130-abec-99400d4028ed', 'volume_name': 'volume-60bbf783-86d7-4130-abec-99400d4028ed', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dba5acf-be84-4644-9350-cb9c470c8188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dba5acf-be84-4644-9350-cb9c470c8188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae9fec9-7db4-42c6-a106-c5d112a7ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:54 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Volume 60bbf783-86d7-4130-abec-99400d4028ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bbf783-86d7-4130-abec-99400d4028ed', 'volume_size': 1} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:54 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (cd9ce2ac-4d07-4f27-bc24-5ed85a432e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218fdc51-e501-4ef9-affb-01e5a0727987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218fdc51-e501-4ef9-affb-01e5a0727987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1367180367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afc6846-c4db-4bf7-bd38-0be0923fcef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7e34ef-604f-4fc0-a9a3-041ecc3b6c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7e34ef-604f-4fc0-a9a3-041ecc3b6c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83ea4e7-6ab8-4cc5-8e94-005c965c45da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83ea4e7-6ab8-4cc5-8e94-005c965c45da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4afc6846-c4db-4bf7-bd38-0be0923fcef7', 'volume_name': 'volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9121d9be-29ba-40b3-af2c-bb091e2a940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9121d9be-29ba-40b3-af2c-bb091e2a940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e07c05-176b-4a45-a086-3cd52258d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Volume 4afc6846-c4db-4bf7-bd38-0be0923fcef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7', 'volume_size': 1} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:55 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 1073741824" returned: 0 in 1.221s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:55 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 Jul 07 17:43:55 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (6d12434b-1908-49f7-9af0-5212342f7c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b41bab8-2fb5-4c3e-88ce-6cb324998e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b41bab8-2fb5-4c3e-88ce-6cb324998e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239805400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e47e648-1e1f-4c77-9457-7f354094211e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650d391b-ce36-449f-8921-613318b61a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650d391b-ce36-449f-8921-613318b61a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2369efc-14da-4ed0-9466-016d3a653160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2369efc-14da-4ed0-9466-016d3a653160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e47e648-1e1f-4c77-9457-7f354094211e', 'volume_name': 'volume-9e47e648-1e1f-4c77-9457-7f354094211e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e0ba80-d7a1-4279-a662-9bcab2beb284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e0ba80-d7a1-4279-a662-9bcab2beb284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dbc10b-ffa9-4e57-928d-56c89c5fd821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Volume 9e47e648-1e1f-4c77-9457-7f354094211e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e47e648-1e1f-4c77-9457-7f354094211e', 'volume_size': 1} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (833973b5-992a-4c1b-b45c-cb4910fe3c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da0fe1b-8ec7-4614-ace4-d3c1b7ef22b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da0fe1b-8ec7-4614-ace4-d3c1b7ef22b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584179999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413fb21c-2d8b-4462-baf5-86c4e86ac0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:56Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0d6d90-411e-4663-b042-d937698eda0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0d6d90-411e-4663-b042-d937698eda0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aa9529-d97c-41a8-9327-0566e0f4d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aa9529-d97c-41a8-9327-0566e0f4d977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413fb21c-2d8b-4462-baf5-86c4e86ac0c0', 'volume_name': 'volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0545cf15-4645-47d8-be73-afb5315e4af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0545cf15-4645-47d8-be73-afb5315e4af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb2061b-7fc6-4024-93c6-973f824ee9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:55 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Volume 413fb21c-2d8b-4462-baf5-86c4e86ac0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0', 'volume_size': 1} Jul 07 17:43:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:56 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718" returned: 0 in 0.837s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-994246721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e48c5a8-71f4-4360-bb7a-9f9353a28ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:54Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Creating volume 6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:56 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:56 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 1073741824 Jul 07 17:43:56 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91012609-df9c-4b1b-9fc2-579d69a6c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe8a8ff-6638-47c8-b781-caf4e221957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:56 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 (e7a2e4ab-53b2-42e7-98d2-05f1e3678718): created successfully Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe8a8ff-6638-47c8-b781-caf4e221957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (dd0b4e7a-6e94-4796-bc34-ac27a562adeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8f02317a-2b47-42ed-a133-acbd42e289bb tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created volume successfully. Jul 07 17:43:56 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 1073741824" returned: 0 in 0.911s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:57 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 Jul 07 17:43:57 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (33b7d6ab-b137-4b44-94df-f6acf6cba490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09958055-dd86-40a7-b189-8ad69a226ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09958055-dd86-40a7-b189-8ad69a226ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644212503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996a260-2d2a-4fdc-bae7-045f3fd843cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:58Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6688a094-7f95-47bf-90a6-c25f69111ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6688a094-7f95-47bf-90a6-c25f69111ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c338fbe-6a11-41e2-a294-0ccd2a67e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c338fbe-6a11-41e2-a294-0ccd2a67e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0996a260-2d2a-4fdc-bae7-045f3fd843cc', 'volume_name': 'volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017b7078-14f2-43dc-9d1c-efb7e5c90ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017b7078-14f2-43dc-9d1c-efb7e5c90ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd0dd38-c0b6-4973-9fe2-94e1493cb08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume 0996a260-2d2a-4fdc-bae7-045f3fd843cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc', 'volume_size': 1} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:57 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.076s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1847416480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d1e32e-8108-4f13-9601-fc51061e1b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a0eee1f24c40e3bfd07b2ff43579d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='7227acc9393c4d5ca895fec90fd2c0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Creating volume 18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:57 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:57 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c 1073741824 Jul 07 17:43:57 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d76bced-f5d9-422b-9cfe-a9d9c113bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02231bd-3722-4fde-8d86-61e529d62f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Volume volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 (6e48c5a8-71f4-4360-bb7a-9f9353a28ec8): created successfully Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02231bd-3722-4fde-8d86-61e529d62f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (4871c7f3-b522-4cb0-9c3e-b10fbbf87fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c423556b-b1f6-41cb-ab5d-b00e0352d12f tempest-CreateVolumesFromImageTest-976355473 None] Created volume successfully. Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (ca87ccbc-ab62-44aa-9e78-e828eebaa92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e52431-da29-44db-97ca-01eb30c6dfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e52431-da29-44db-97ca-01eb30c6dfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138529613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85729d44-61c0-4423-a862-019b297f7a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:58Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c4d33a-6adb-448e-8ae0-5b5a64c1e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c4d33a-6adb-448e-8ae0-5b5a64c1e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4551fc87-b5a1-4f06-a8bf-22bfdd395924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4551fc87-b5a1-4f06-a8bf-22bfdd395924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85729d44-61c0-4423-a862-019b297f7a30', 'volume_name': 'volume-85729d44-61c0-4423-a862-019b297f7a30', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2398eb-239f-481c-873d-ef797b752285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2398eb-239f-481c-873d-ef797b752285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05467a8-9730-4266-842a-b2f3bcfc46cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume 85729d44-61c0-4423-a862-019b297f7a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85729d44-61c0-4423-a862-019b297f7a30', 'volume_size': 1} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (48ce9934-9e3b-4c11-bbaa-3f91b6db8ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7a8a7f-c18a-46e7-9991-f1469b026561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7a8a7f-c18a-46e7-9991-f1469b026561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175814235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5f4c2a-5eab-4f01-a51c-70151fa2952d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:58Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbee43d0-97ac-4efa-95e7-70f3f7dcf37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbee43d0-97ac-4efa-95e7-70f3f7dcf37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73594b28-5f61-4dcc-8040-8c29d75bd9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73594b28-5f61-4dcc-8040-8c29d75bd9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5f4c2a-5eab-4f01-a51c-70151fa2952d', 'volume_name': 'volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7220f8ee-9ce3-4931-a047-21d301475cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7220f8ee-9ce3-4931-a047-21d301475cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9828caa-ddda-4b33-ace9-5f2585385829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume 6f5f4c2a-5eab-4f01-a51c-70151fa2952d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d', 'volume_size': 1} Jul 07 17:43:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:59 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c 1073741824" returned: 0 in 1.246s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:59 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:43:59 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (20dbea01-8a64-43ba-af00-95147ebc3663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469a520d-651a-495e-81be-2ead037b58d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469a520d-651a-495e-81be-2ead037b58d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040298999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f1a193-a078-4f22-ae67-fa07cb134d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:59Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a034bb-f301-4e86-bf57-61f3ca0c04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a034bb-f301-4e86-bf57-61f3ca0c04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1641dd73-09b8-43ba-835a-34927190d3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1641dd73-09b8-43ba-835a-34927190d3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f1a193-a078-4f22-ae67-fa07cb134d94', 'volume_name': 'volume-b2f1a193-a078-4f22-ae67-fa07cb134d94', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73991c8-d564-4c94-97b7-71c97b938cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73991c8-d564-4c94-97b7-71c97b938cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39b5d44-55f2-44e2-aa0a-b3205d9bdbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume b2f1a193-a078-4f22-ae67-fa07cb134d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f1a193-a078-4f22-ae67-fa07cb134d94', 'volume_size': 1} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Flow 'volume_create_manager' (f268de88-6205-4695-9f86-ec3f020c86e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d3eedc-c808-4696-93b0-6808620fdab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d3eedc-c808-4696-93b0-6808620fdab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bfc45e-8b59-4e6b-b0bb-2483bbfacd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a53c7569134673b55f95bd7ade3d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:59Z,use_quota=True,user_id='ad1960bb944047d38abdc0f4c8e41a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a49daeeb-577c-4404-baf9-863b3db6381d),volume_type_id=a49daeeb-577c-4404-baf9-863b3db6381d)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7791ac3f-16f5-4125-9695-748be344793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7791ac3f-16f5-4125-9695-748be344793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d9ef13-46b5-464d-ba64-1f829ea90b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (6dd4133a-ecb0-4a47-9613-4d93c14d9fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d0a4ff-b1ce-4ba8-8c68-f1b492e336f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d0a4ff-b1ce-4ba8-8c68-f1b492e336f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1943365984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e79107-588d-44c6-8c4d-1edbb8489d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:00Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda0f1c1-05e2-4959-bb1e-d62dc2b9dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda0f1c1-05e2-4959-bb1e-d62dc2b9dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bb2670-43fb-4be3-992f-2c058c88dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bb2670-43fb-4be3-992f-2c058c88dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e79107-588d-44c6-8c4d-1edbb8489d15', 'volume_name': 'volume-e8e79107-588d-44c6-8c4d-1edbb8489d15', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb6ba67-9738-41b7-8968-1158ba702ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb6ba67-9738-41b7-8968-1158ba702ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84600ed8-0040-41b8-b6fc-ae282891e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume e8e79107-588d-44c6-8c4d-1edbb8489d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e79107-588d-44c6-8c4d-1edbb8489d15', 'volume_size': 1} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:59 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.916s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440087852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bbf783-86d7-4130-abec-99400d4028ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Creating volume 60bbf783-86d7-4130-abec-99400d4028ed {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:59 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:59 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed 1073741824 Jul 07 17:43:59 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc59d8d1-c6dd-48b3-80e5-39e12b9536c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d1e32e-8108-4f13-9601-fc51061e1b0c', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b4807-5f81-471e-9be6-b8e3ec3f068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:59 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Volume volume-18d1e32e-8108-4f13-9601-fc51061e1b0c (18d1e32e-8108-4f13-9601-fc51061e1b0c): created successfully Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b4807-5f81-471e-9be6-b8e3ec3f068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Flow 'volume_create_manager' (2b3b2c91-1e26-4670-8965-bb6fc0b9d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-50b8d3b3-f5e2-469a-a2c1-59de5b3f3f04 tempest-VolumeDependencyTests-450374352 None] Created volume successfully. Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d9ef13-46b5-464d-ba64-1f829ea90b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68bfc45e-8b59-4e6b-b0bb-2483bbfacd88', 'volume_name': 'volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88', 'volume_size': 1, 'image_id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4ed6254-e918-4902-a431-6e464f93d8eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9a2914176ccce0a6dbfb25a687d0a64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23a53c7569134673b55f95bd7ade3d87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'efd759240e4f14c6758e42966c8cbd64a8e4dc98fbdedffbcc5e559979c7fc669cf3f26e21bb880e4ed17ad9e9822a83ad574c7b2dd9c71c6581ce93620d4243', 'id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'created_at': datetime.datetime(2026, 7, 7, 15, 43, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 43, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4ed6254-e918-4902-a431-6e464f93d8eb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be53a6b-d6c0-4073-8da9-10e64af39973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be53a6b-d6c0-4073-8da9-10e64af39973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1376319-e66e-4d27-809b-1006cbd79f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Volume 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88', 'volume_size': 1, 'image_id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4ed6254-e918-4902-a431-6e464f93d8eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9a2914176ccce0a6dbfb25a687d0a64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23a53c7569134673b55f95bd7ade3d87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'efd759240e4f14c6758e42966c8cbd64a8e4dc98fbdedffbcc5e559979c7fc669cf3f26e21bb880e4ed17ad9e9822a83ad574c7b2dd9c71c6581ce93620d4243', 'id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'created_at': datetime.datetime(2026, 7, 7, 15, 43, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 43, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4ed6254-e918-4902-a431-6e464f93d8eb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Trying to clone 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 from image c4ed6254-e918-4902-a431-6e464f93d8eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4ed6254-e918-4902-a431-6e464f93d8eb', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:44:00 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad99e4-502c-44dc-a9f2-8320e9f78641]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:00 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD Jul 07 17:44:00 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:00 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed 1073741824" returned: 0 in 1.013s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:00 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed Jul 07 17:44:00 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:01 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:01 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD Jul 07 17:44:01 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:01 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:01 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 1073741824 Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed" returned: 0 in 0.773s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.650s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1367180367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afc6846-c4db-4bf7-bd38-0be0923fcef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Creating volume 4afc6846-c4db-4bf7-bd38-0be0923fcef7 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:01 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:01 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae9fec9-7db4-42c6-a106-c5d112a7ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bbf783-86d7-4130-abec-99400d4028ed', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c586ee52-ff66-4c7b-8095-a68052325677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Volume volume-60bbf783-86d7-4130-abec-99400d4028ed (60bbf783-86d7-4130-abec-99400d4028ed): created successfully Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c586ee52-ff66-4c7b-8095-a68052325677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (d481456d-1c99-4809-8da0-253c9bd272e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b1133e18-bb35-4d01-ae6e-c6cbba487ff0 tempest-CreateVolumesFromImageTest-976355473 None] Created volume successfully. Jul 07 17:44:02 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD" returned: 1 in 0.905s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Temporary image c4ed6254-e918-4902-a431-6e464f93d8eb is fetched for user ad1960bb944047d38abdc0f4c8e41a73. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d4eb72-3923-427f-836a-5e434f12c063]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:02 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD Jul 07 17:44:02 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:02 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 1073741824" returned: 0 in 1.005s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:02 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 Jul 07 17:44:02 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:02 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:03 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD Jul 07 17:44:03 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:03 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7" returned: 0 in 0.719s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.113s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239805400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e47e648-1e1f-4c77-9457-7f354094211e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:55Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Creating volume 9e47e648-1e1f-4c77-9457-7f354094211e {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:03 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e07c05-176b-4a45-a086-3cd52258d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:03 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e 1073741824 Jul 07 17:44:03 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aef9f8-1046-4480-891a-7c1c0eddab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:03 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Volume volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 (4afc6846-c4db-4bf7-bd38-0be0923fcef7): created successfully Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aef9f8-1046-4480-891a-7c1c0eddab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (cd9ce2ac-4d07-4f27-bc24-5ed85a432e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:03 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-deb2eaa8-87ed-414d-a101-28c72aced05c tempest-CreateVolumesFromImageTest-976355473 None] Created volume successfully. Jul 07 17:44:03 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD" returned: 1 in 0.809s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:04 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e 1073741824" returned: 0 in 0.860s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:04 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e Jul 07 17:44:04 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:05 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e" returned: 0 in 0.667s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.217s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584179999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413fb21c-2d8b-4462-baf5-86c4e86ac0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a723e646998405a9de4c96081b0530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:56Z,use_quota=True,user_id='f7e68b51b7684cb0bb96bb78f62de1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Creating volume 413fb21c-2d8b-4462-baf5-86c4e86ac0c0 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:05 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:05 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 1073741824 Jul 07 17:44:05 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dbc10b-ffa9-4e57-928d-56c89c5fd821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e47e648-1e1f-4c77-9457-7f354094211e', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc703a2a-0c88-4990-b23f-e89894120d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:05 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Volume volume-9e47e648-1e1f-4c77-9457-7f354094211e (9e47e648-1e1f-4c77-9457-7f354094211e): created successfully Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc703a2a-0c88-4990-b23f-e89894120d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (6d12434b-1908-49f7-9af0-5212342f7c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b464b7b0-71d2-43b3-acae-167cf2214eaf tempest-CreateVolumesFromImageTest-976355473 None] Created volume successfully. Jul 07 17:44:05 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 1073741824" returned: 0 in 0.824s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:05 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 Jul 07 17:44:05 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:06 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0" returned: 0 in 0.611s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.875s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644212503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996a260-2d2a-4fdc-bae7-045f3fd843cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:58Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Creating volume 0996a260-2d2a-4fdc-bae7-045f3fd843cc {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:06 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:06 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc 1073741824 Jul 07 17:44:06 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb2061b-7fc6-4024-93c6-973f824ee9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df4a7f0-5bfe-4fc7-9a2f-46d53b583c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Volume volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 (413fb21c-2d8b-4462-baf5-86c4e86ac0c0): created successfully Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df4a7f0-5bfe-4fc7-9a2f-46d53b583c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Flow 'volume_create_manager' (833973b5-992a-4c1b-b45c-cb4910fe3c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5ca2c5ff-67de-4522-99a8-9b3c6ef12344 tempest-CreateVolumesFromImageTest-976355473 None] Created volume successfully. Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-413fb21c-2d8b-4462-baf5-86c4e86ac0c0-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-413fb21c-2d8b-4462-baf5-86c4e86ac0c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-quobyte-413fb21c-2d8b-4462-baf5-86c4e86ac0c0" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-413fb21c-2d8b-4462-baf5-86c4e86ac0c0" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f1d0f-90d3-4bf3-acee-6602068aff88]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:07 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 Jul 07 17:44:07 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:07 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc 1073741824" returned: 0 in 0.885s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:07 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc Jul 07 17:44:07 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:07 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0" returned: 0 in 0.816s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:07 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0 Jul 07 17:44:07 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:08 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc" returned: 0 in 0.663s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.999s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138529613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85729d44-61c0-4423-a862-019b297f7a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:58Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Creating volume 85729d44-61c0-4423-a862-019b297f7a30 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:08 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd0dd38-c0b6-4973-9fe2-94e1493cb08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:08 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 1073741824 Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645a38d4-34c8-4021-8e2f-1813f5589fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:08 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc (0996a260-2d2a-4fdc-bae7-045f3fd843cc): created successfully Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645a38d4-34c8-4021-8e2f-1813f5589fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (33b7d6ab-b137-4b44-94df-f6acf6cba490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-be3171c5-77fd-4235-9548-384dd67a47ca tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created volume successfully. Jul 07 17:44:08 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-413fb21c-2d8b-4462-baf5-86c4e86ac0c0" returned: 0 in 0.691s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-413fb21c-2d8b-4462-baf5-86c4e86ac0c0" released by "delete_volume" :: held 1.546s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Created reservations ['c529bb7a-d1c2-48bc-9efe-1c37ed4b8ef7', '7306f380-b30b-4c14-bd24-f0de5a1fb533', '1f0324a6-ea76-4fff-8b64-0b45c216e4aa', 'fa978796-09fa-413d-bf04-3a990d6aad0f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:08 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:08 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 1073741824" returned: 0 in 0.897s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-9e47e648-1e1f-4c77-9457-7f354094211e-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-9e47e648-1e1f-4c77-9457-7f354094211e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:09 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 Jul 07 17:44:09 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-quobyte-9e47e648-1e1f-4c77-9457-7f354094211e" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-9e47e648-1e1f-4c77-9457-7f354094211e" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[03549f98-1aaa-4571-b276-c7a0be6d578b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:09 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e Jul 07 17:44:09 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Deleted volume successfully. Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0ed18399-1b20-4a7c-a2bc-f760bcdef2b1 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-413fb21c-2d8b-4462-baf5-86c4e86ac0c0-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:09 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30" returned: 0 in 0.711s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.192s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175814235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5f4c2a-5eab-4f01-a51c-70151fa2952d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:58Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Creating volume 6f5f4c2a-5eab-4f01-a51c-70151fa2952d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:09 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:09 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d 1073741824 Jul 07 17:44:09 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05467a8-9730-4266-842a-b2f3bcfc46cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85729d44-61c0-4423-a862-019b297f7a30', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d589e6-4cd5-4873-9d37-7eccc4879b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:09 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume volume-85729d44-61c0-4423-a862-019b297f7a30 (85729d44-61c0-4423-a862-019b297f7a30): created successfully Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d589e6-4cd5-4873-9d37-7eccc4879b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:09 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (ca87ccbc-ab62-44aa-9e78-e828eebaa92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:09 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ec40e9d1-2d85-4ef0-9aa8-d1950aa2abac tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created volume successfully. Jul 07 17:44:10 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e" returned: 0 in 0.848s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:10 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e Jul 07 17:44:10 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:10 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d 1073741824" returned: 0 in 0.884s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:10 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-9e47e648-1e1f-4c77-9457-7f354094211e" returned: 0 in 0.709s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:10 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-9e47e648-1e1f-4c77-9457-7f354094211e" released by "delete_volume" :: held 1.608s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:10 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Created reservations ['25f0e3e9-b4b5-49e9-81e1-404f0efec6cc', '0d20370c-aedd-47be-b181-af620d1c1fb5', '3c61d85e-fae3-42a1-a6ba-8e05b4722ac2', '4cea8933-4439-4675-aadb-72a11e378145'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:10 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:10 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-4afc6846-c4db-4bf7-bd38-0be0923fcef7-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-4afc6846-c4db-4bf7-bd38-0be0923fcef7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-quobyte-4afc6846-c4db-4bf7-bd38-0be0923fcef7" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-4afc6846-c4db-4bf7-bd38-0be0923fcef7" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c33502-c244-443a-a4b3-d0c40b3166b5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:11 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d" returned: 0 in 0.752s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.059s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040298999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f1a193-a078-4f22-ae67-fa07cb134d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:59Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Creating volume b2f1a193-a078-4f22-ae67-fa07cb134d94 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:11 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:11 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 1073741824 Jul 07 17:44:11 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9828caa-ddda-4b33-ace9-5f2585385829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4a5843-20e6-4889-ad43-9ec6b8054afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d (6f5f4c2a-5eab-4f01-a51c-70151fa2952d): created successfully Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4a5843-20e6-4889-ad43-9ec6b8054afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (48ce9934-9e3b-4c11-bbaa-3f91b6db8ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:11 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 Jul 07 17:44:11 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-a40d9f64-1650-44fb-a491-9fdeed5c06ab tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created volume successfully. Jul 07 17:44:11 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.765s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Deleted volume successfully. Jul 07 17:44:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bc48cd26-a0d1-4597-a4b7-88ed867d859f tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-9e47e648-1e1f-4c77-9457-7f354094211e-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:12 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7" returned: 0 in 0.826s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:12 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7 Jul 07 17:44:12 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:12 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 1073741824" returned: 0 in 0.919s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:12 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 Jul 07 17:44:12 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:13 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4afc6846-c4db-4bf7-bd38-0be0923fcef7" returned: 0 in 0.672s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-4afc6846-c4db-4bf7-bd38-0be0923fcef7" released by "delete_volume" :: held 1.554s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Created reservations ['fd57bc60-2662-47f3-be8b-a1612bfe12ef', 'a097c7a8-6be8-4fc8-960c-482992f6198e', '4746724c-2acb-458a-b5de-efd22af6e3d4', '2dc9ffca-ed66-495e-8d55-da74d3a6e50e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:13 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:13 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:13 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94" returned: 0 in 0.675s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.388s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1943365984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e79107-588d-44c6-8c4d-1edbb8489d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa8ca1a6f4a4d2793167afc133986b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:00Z,use_quota=True,user_id='3651686a258b40fd83e0d015f6154d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Creating volume e8e79107-588d-44c6-8c4d-1edbb8489d15 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:13 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39b5d44-55f2-44e2-aa0a-b3205d9bdbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f1a193-a078-4f22-ae67-fa07cb134d94', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:13 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 1073741824 Jul 07 17:44:13 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d0887c-f4bc-46ba-b3ec-173f4fe0cd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:13 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 (b2f1a193-a078-4f22-ae67-fa07cb134d94): created successfully Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d0887c-f4bc-46ba-b3ec-173f4fe0cd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (20dbea01-8a64-43ba-af00-95147ebc3663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cbf44d4e-10c7-4165-93aa-1973838ced89 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created volume successfully. Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-60bbf783-86d7-4130-abec-99400d4028ed-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-60bbf783-86d7-4130-abec-99400d4028ed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-quobyte-60bbf783-86d7-4130-abec-99400d4028ed" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-60bbf783-86d7-4130-abec-99400d4028ed" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[586717c7-7e43-43fa-81ab-30a88406daf4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:13 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.697s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:13 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Deleted volume successfully. Jul 07 17:44:13 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7de0452b-9518-4654-824a-df4f60ac6d19 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-4afc6846-c4db-4bf7-bd38-0be0923fcef7-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:13 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed Jul 07 17:44:13 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:14 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 1073741824" returned: 0 in 0.959s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:14 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 Jul 07 17:44:14 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:14 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed" returned: 0 in 0.833s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:14 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed Jul 07 17:44:14 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:14 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15" returned: 0 in 0.700s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.480s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Creating offline snapshot ca583904-a84b-4dc1-add9-4fd476550860 of volume 18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84600ed8-0040-41b8-b6fc-ae282891e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e79107-588d-44c6-8c4d-1edbb8489d15', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c750b5f2-6ff8-4422-aa27-98756c82f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[516af706-c4dd-47a7-8179-a6afe46a4339]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:15 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Volume volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 (e8e79107-588d-44c6-8c4d-1edbb8489d15): created successfully Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c750b5f2-6ff8-4422-aa27-98756c82f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Flow 'volume_create_manager' (6dd4133a-ecb0-4a47-9613-4d93c14d9fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:15 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-deadae57-3989-4144-b8a3-e1f28bf349cc tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created volume successfully. Jul 07 17:44:15 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:44:15 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:15 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-60bbf783-86d7-4130-abec-99400d4028ed" returned: 0 in 0.695s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-60bbf783-86d7-4130-abec-99400d4028ed" released by "delete_volume" :: held 1.586s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Created reservations ['ce9e224e-c165-4b83-8bad-db6f4eb37d93', 'f676e0a3-5cf7-459b-8486-423a273f5923', '0e5a86fb-8709-457f-9b12-80b29c530643', '6a7b5703-f9f8-47d7-aaa2-7ca52b0f067d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:15 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:15 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:15 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:15 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 1G Jul 07 17:44:15 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-e8e79107-588d-44c6-8c4d-1edbb8489d15-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-e8e79107-588d-44c6-8c4d-1edbb8489d15-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-quobyte-e8e79107-588d-44c6-8c4d-1edbb8489d15" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-e8e79107-588d-44c6-8c4d-1edbb8489d15" acquired by "delete_volume" :: waited 0.037s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccea56c8-7d53-4c82-b979-75edcf1f2264]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "cinder-quobyte-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c0bd5-de4d-4b9b-b81d-991a9b6df3fe]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 Jul 07 17:44:16 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.795s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Deleted volume successfully. Jul 07 17:44:16 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 Jul 07 17:44:16 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-08e3bd32-e0a3-4b9e-9cd9-86dcd3ac12f9 tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-60bbf783-86d7-4130-abec-99400d4028ed-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:16 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 1G" returned: 0 in 1.011s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d1e32e-8108-4f13-9601-fc51061e1b0c -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d1e32e-8108-4f13-9601-fc51061e1b0c -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 Jul 07 17:44:16 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15" returned: 0 in 0.921s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:17 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15 Jul 07 17:44:17 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8" returned: 0 in 0.864s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:17 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8 Jul 07 17:44:17 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d1e32e-8108-4f13-9601-fc51061e1b0c -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860" returned: 0 in 0.757s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 is being set with open permissions: ugo+rw Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:17 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 Jul 07 17:44:17 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e8e79107-588d-44c6-8c4d-1edbb8489d15" returned: 0 in 0.689s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-e8e79107-588d-44c6-8c4d-1edbb8489d15" released by "delete_volume" :: held 1.658s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created reservations ['62b58826-4afc-42f6-8967-778ffe3ec038', 'cea23a5d-c250-49f0-8168-3a0f1027ab99', 'e0763ec5-3478-4a4b-a74d-98a8a9d65a29', 'd3a0e9f0-3e97-4327-b78e-a987539a102c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:17 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8" returned: 0 in 0.736s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-quobyte-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8" released by "delete_volume" :: held 1.665s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:17 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:17 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Created reservations ['aae3ea5a-c47d-49a8-b79f-dc5c72bc572f', '4d5cccb9-13c1-4cab-87dd-2c939593b314', 'b443e30b-126d-48df-9714-4698f1adcf67', '647a0217-5966-4149-bf50-93f3af645fc8'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:18 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:18 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-b2f1a193-a078-4f22-ae67-fa07cb134d94-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-b2f1a193-a078-4f22-ae67-fa07cb134d94-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:18 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860" returned: 0 in 0.749s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-quobyte-b2f1a193-a078-4f22-ae67-fa07cb134d94" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-b2f1a193-a078-4f22-ae67-fa07cb134d94" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[623a27ac-1793-45f0-9bae-b7159231cfef]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:18 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info Jul 07 17:44:18 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:18 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 Jul 07 17:44:18 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:18 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.890s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Deleted volume successfully. Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-92fe9d67-970c-477c-89c8-b15ff8d48ef2 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-e8e79107-588d-44c6-8c4d-1edbb8489d15-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:18 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.851s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:18 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Deleted volume successfully. Jul 07 17:44:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-15b27918-9f78-4f40-b722-3637aa197b6b tempest-CreateVolumesFromImageTest-976355473 None] Lock "cinder-6e48c5a8-71f4-4360-bb7a-9f9353a28ec8-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:19 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info" returned: 0 in 0.845s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:19 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info is being set with open permissions: ugo+rw Jul 07 17:44:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:19 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info Jul 07 17:44:19 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:19 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94" returned: 0 in 1.085s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:19 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94 Jul 07 17:44:19 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:20 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.info" returned: 0 in 0.817s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.201s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.347s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bfc45e-8b59-4e6b-b0bb-2483bbfacd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a53c7569134673b55f95bd7ade3d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:59Z,use_quota=True,user_id='ad1960bb944047d38abdc0f4c8e41a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a49daeeb-577c-4404-baf9-863b3db6381d),volume_type_id=a49daeeb-577c-4404-baf9-863b3db6381d)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Creating volume 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:20 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:20 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 1073741824 Jul 07 17:44:20 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-33e417d6-2b39-431a-865c-619dcb8a17eb tempest-VolumeDependencyTests-450374352 None] Create snapshot completed successfully Jul 07 17:44:20 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b2f1a193-a078-4f22-ae67-fa07cb134d94" returned: 0 in 0.761s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-b2f1a193-a078-4f22-ae67-fa07cb134d94" released by "delete_volume" :: held 1.922s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created reservations ['3b386fbd-03bc-4951-b246-4fff91752880', 'e9ced138-4eed-4476-8822-9e708bfc5b24', '133accd4-218c-44d3-988e-a59cc007f65c', 'e6fd4cc2-bb47-4f0d-9eeb-0dcbe33a773d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:20 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:20 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-6f5f4c2a-5eab-4f01-a51c-70151fa2952d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-6f5f4c2a-5eab-4f01-a51c-70151fa2952d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-quobyte-6f5f4c2a-5eab-4f01-a51c-70151fa2952d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-6f5f4c2a-5eab-4f01-a51c-70151fa2952d" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aba07a-fcfe-4c26-bc4e-f03df3b5c4a7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:21 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d Jul 07 17:44:21 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:21 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.795s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:21 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Deleted volume successfully. Jul 07 17:44:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dc243e3d-4965-4624-a63a-f85e18bc1683 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-b2f1a193-a078-4f22-ae67-fa07cb134d94-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:21 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 1073741824" returned: 0 in 1.199s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:21 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:21 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:21 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:21 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d" returned: 0 in 1.171s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Flow 'volume_create_manager' (d91f5992-1ff1-4b4d-a490-fbeb0f2d35ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:22 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d Jul 07 17:44:22 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb4ae39-79e9-4063-862e-8ac0a1784654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb4ae39-79e9-4063-862e-8ac0a1784654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1959905831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84239f72-2b62-4ab7-97de-1c2623fe9b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a0eee1f24c40e3bfd07b2ff43579d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca583904-a84b-4dc1-add9-4fd476550860,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:22Z,use_quota=True,user_id='7227acc9393c4d5ca895fec90fd2c0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579ebe1-e05c-436e-abf3-14c8f2059ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579ebe1-e05c-436e-abf3-14c8f2059ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909a25db-4ce9-4323-b0a4-6e5bf27f2f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909a25db-4ce9-4323-b0a4-6e5bf27f2f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84239f72-2b62-4ab7-97de-1c2623fe9b10', 'volume_name': 'volume-84239f72-2b62-4ab7-97de-1c2623fe9b10', 'volume_size': 1, 'snapshot_id': 'ca583904-a84b-4dc1-add9-4fd476550860'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b146555-efd0-4f57-a79b-7452aee20295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b146555-efd0-4f57-a79b-7452aee20295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fa424f-9184-4ca6-9b86-795785171619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:22 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Volume 84239f72-2b62-4ab7-97de-1c2623fe9b10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84239f72-2b62-4ab7-97de-1c2623fe9b10', 'volume_size': 1, 'snapshot_id': 'ca583904-a84b-4dc1-add9-4fd476550860'} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:22 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 0 in 0.897s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.193s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-quobyte-ca583904-a84b-4dc1-add9-4fd476550860-84239f72-2b62-4ab7-97de-1c2623fe9b10" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-ca583904-a84b-4dc1-add9-4fd476550860-84239f72-2b62-4ab7-97de-1c2623fe9b10" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Creating volume 84239f72-2b62-4ab7-97de-1c2623fe9b10 from snapshot ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-quobyte-84239f72-2b62-4ab7-97de-1c2623fe9b10" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Attempting download of c4ed6254-e918-4902-a431-6e464f93d8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/c4ed6254-e918-4902-a431-6e464f93d8eb', 'metadata': {}}])) to volume 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-84239f72-2b62-4ab7-97de-1c2623fe9b10" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] snapshot: ca583904-a84b-4dc1-add9-4fd476550860, volume: 84239f72-2b62-4ab7-97de-1c2623fe9b10, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[02398a29-980f-4621-b74c-dc27b3f68ec3]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb8a1ff-ba70-45b1-ab13-7d9520c6111b]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:22 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57 Jul 07 17:44:22 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:22 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 Jul 07 17:44:22 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:22 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6f5f4c2a-5eab-4f01-a51c-70151fa2952d" returned: 0 in 0.839s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-6f5f4c2a-5eab-4f01-a51c-70151fa2952d" released by "delete_volume" :: held 2.077s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:22 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created reservations ['b6f2d96f-b7aa-42c5-ac1c-608013ba98f1', 'b8b4e29b-c0a8-4765-bae7-15dda29c0cba', '0a94aae5-4ee1-4295-b8ac-9742323066ef', '72217e6f-23f5-4fd8-8afc-e006db24e356'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:23 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:23 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:23 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57" returned: 0 in 0.973s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:23 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860" returned: 0 in 1.083s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d1e32e-8108-4f13-9601-fc51061e1b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26b2da6-9c43-44fa-a7df-b81b1cb1c501]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:23 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57 Jul 07 17:44:23 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:23 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:44:23 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:23 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.812s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Deleted volume successfully. Jul 07 17:44:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-285d11c4-ce4f-4c8e-ae62-29e7200fedf3 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-6f5f4c2a-5eab-4f01-a51c-70151fa2952d-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-85729d44-61c0-4423-a862-019b297f7a30-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-85729d44-61c0-4423-a862-019b297f7a30-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-quobyte-85729d44-61c0-4423-a862-019b297f7a30" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-85729d44-61c0-4423-a862-019b297f7a30" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1befd6cc-a508-42de-a30f-ca64606f2e75]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:24 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 Jul 07 17:44:24 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:24 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57" returned: 1 in 1.035s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4ed6254-e918-4902-a431-6e464f93d8eb_7cyt8w57' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c431e103-a743-4cf3-8c9f-be9997e20e3b]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:24 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 1.029s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:44:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:24 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 Jul 07 17:44:24 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:24 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD Jul 07 17:44:24 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:25 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:25 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30" returned: 0 in 1.217s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:25 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30 Jul 07 17:44:25 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:25 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD Jul 07 17:44:25 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:26 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-85729d44-61c0-4423-a862-019b297f7a30" returned: 0 in 1.447s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-85729d44-61c0-4423-a862-019b297f7a30" released by "delete_volume" :: held 2.736s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created reservations ['ba66d017-a321-4bd4-99b8-02a933a83ad6', '496a5c39-f5ed-4eae-a099-619284ec86c0', '1383a31f-1212-4c7f-9bb9-326f42696e90', '4cb41853-b618-43c6-ac57-36f0f0437215'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:27 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD" returned: 1 in 1.796s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] c4ed6254-e918-4902-a431-6e464f93d8eb was raw, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:44:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:27 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:27 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:27 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:27 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-0996a260-2d2a-4fdc-bae7-045f3fd843cc-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-0996a260-2d2a-4fdc-bae7-045f3fd843cc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-quobyte-0996a260-2d2a-4fdc-bae7-045f3fd843cc" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-0996a260-2d2a-4fdc-bae7-045f3fd843cc" acquired by "delete_volume" :: waited 0.047s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa4b678-8382-41b6-a68b-2c15961b2301]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:28 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc Jul 07 17:44:28 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:29 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 0 in 1.845s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:29 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4ed6254-e918-4902-a431-6e464f93d8eb_ybjw3h7qdevstack@QuobyteHD, size 0.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:44:29 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:44:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:29 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 1G Jul 07 17:44:29 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:29 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 2.619s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:29 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Deleted volume successfully. Jul 07 17:44:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f4e1e363-99a2-47cf-87c9-2e4fb3c6b634 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-85729d44-61c0-4423-a862-019b297f7a30-delete_volume" released by "delete_volume" :: held 5.762s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:30 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc" returned: 0 in 2.065s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:30 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc Jul 07 17:44:30 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 1G" returned: 0 in 2.149s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[04364151-116f-4cdc-9f00-cc326daef87f]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:31 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:31 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10" returned: 0 in 6.928s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5f1fc-9d82-4994-bea4-5c2ae138851d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:31 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-0996a260-2d2a-4fdc-bae7-045f3fd843cc" returned: 0 in 1.119s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-0996a260-2d2a-4fdc-bae7-045f3fd843cc" released by "delete_volume" :: held 3.274s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:31 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:44:31 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created reservations ['41e7205e-5c1b-4f85-8e89-49175b652cb0', '535040ab-69d2-4868-831e-8a8bd4612863', 'fdb6a1dc-9f29-4873-8ead-14696e2267bd', '3c9e353b-49ac-4b63-9dbd-e9f249242923'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:31 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:31 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-e7a2e4ab-53b2-42e7-98d2-05f1e3678718-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-e7a2e4ab-53b2-42e7-98d2-05f1e3678718-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "cinder-quobyte-e7a2e4ab-53b2-42e7-98d2-05f1e3678718" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-e7a2e4ab-53b2-42e7-98d2-05f1e3678718" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb03342-aecf-4a23-8af0-0a19e1039451]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:32 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 Jul 07 17:44:32 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 0 in 1.046s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:32 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:32 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:32 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 1.235s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:44:32 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Converted 1024.00 MB image at 147.76 MB/s Jul 07 17:44:32 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 is being set with open permissions: ugo+rw Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:32 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:32 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 Jul 07 17:44:32 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.048s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Deleted volume successfully. Jul 07 17:44:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-3f159fb7-c04f-478e-9c15-3f03f0035d57 tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-0996a260-2d2a-4fdc-bae7-045f3fd843cc-delete_volume" released by "delete_volume" :: held 4.767s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718" returned: 0 in 1.130s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:33 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718 Jul 07 17:44:33 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:33 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 1 in 1.173s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Downloaded image c4ed6254-e918-4902-a431-6e464f93d8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/c4ed6254-e918-4902-a431-6e464f93d8eb', 'metadata': {}}])) to volume 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Temporary image c4ed6254-e918-4902-a431-6e464f93d8eb for user ad1960bb944047d38abdc0f4c8e41a73 is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Marking volume 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Copying metadata from image c4ed6254-e918-4902-a431-6e464f93d8eb to 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Creating volume glance metadata for volume 68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 backed by image c4ed6254-e918-4902-a431-6e464f93d8eb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f9a2914176ccce0a6dbfb25a687d0a64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1376319-e66e-4d27-809b-1006cbd79f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88', 'volume_size': 1, 'image_id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4ed6254-e918-4902-a431-6e464f93d8eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9a2914176ccce0a6dbfb25a687d0a64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23a53c7569134673b55f95bd7ade3d87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'efd759240e4f14c6758e42966c8cbd64a8e4dc98fbdedffbcc5e559979c7fc669cf3f26e21bb880e4ed17ad9e9822a83ad574c7b2dd9c71c6581ce93620d4243', 'id': 'c4ed6254-e918-4902-a431-6e464f93d8eb', 'created_at': datetime.datetime(2026, 7, 7, 15, 43, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 43, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4ed6254-e918-4902-a431-6e464f93d8eb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e4cff1-b07c-4d4d-9542-80625a9277f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:33 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Volume volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 (68bfc45e-8b59-4e6b-b0bb-2483bbfacd88): created successfully Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e4cff1-b07c-4d4d-9542-80625a9277f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Flow 'volume_create_manager' (f268de88-6205-4695-9f86-ec3f020c86e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4382e0a0-cd48-4738-9dca-3b46a1e56767 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Created volume successfully. Jul 07 17:44:33 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.153s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:44:33 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10" returned: 0 in 1.180s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-84239f72-2b62-4ab7-97de-1c2623fe9b10" released by "_copy_volume_from_snapshot" :: held 11.593s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-ca583904-a84b-4dc1-add9-4fd476550860-84239f72-2b62-4ab7-97de-1c2623fe9b10" released by "_create_volume_from_snapshot" :: held 11.639s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.667s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fa424f-9184-4ca6-9b86-795785171619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84239f72-2b62-4ab7-97de-1c2623fe9b10', 'volume_size': 1, 'snapshot_id': 'ca583904-a84b-4dc1-add9-4fd476550860'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf62074-3973-4a18-aeae-58fabd79ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:34 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Volume volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 (84239f72-2b62-4ab7-97de-1c2623fe9b10): created successfully Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf62074-3973-4a18-aeae-58fabd79ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Flow 'volume_create_manager' (d91f5992-1ff1-4b4d-a490-fbeb0f2d35ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:34 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e7a2e4ab-53b2-42e7-98d2-05f1e3678718" returned: 0 in 0.797s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e50e5698-f64b-4a84-b0e4-4536658953fa tempest-VolumeDependencyTests-450374352 None] Created volume successfully. Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-quobyte-e7a2e4ab-53b2-42e7-98d2-05f1e3678718" released by "delete_volume" :: held 1.994s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Created reservations ['598836ff-ad7a-4daf-b80e-2c70ac9c7059', '0fa90535-73e2-4723-8a2a-2552e450ac88', '83476347-c80a-4877-9201-969c2d555e26', 'd7695a5a-b8c3-4395-9217-ce989c9796d1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:34 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:34 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-ca583904-a84b-4dc1-add9-4fd476550860-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-ca583904-a84b-4dc1-add9-4fd476550860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-quobyte-18d1e32e-8108-4f13-9601-fc51061e1b0c" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Acquiring lock "cinder-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-18d1e32e-8108-4f13-9601-fc51061e1b0c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-quobyte-ca583904-a84b-4dc1-add9-4fd476550860" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-ca583904-a84b-4dc1-add9-4fd476550860" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Deleting offline snapshot ca583904-a84b-4dc1-add9-4fd476550860 of volume 18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] snapshot_file for this snap is: volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "cinder-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d935231c-8d89-48f9-89c9-c8ae93634a33]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Acquiring lock "cinder-quobyte-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "cinder-quobyte-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae81432-7517-40e8-acbe-d3fdc0dba938]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:34 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 Jul 07 17:44:34 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:34 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:34 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:35 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.020s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Deleted volume successfully. Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-227fc4ea-ca4c-4374-a0a8-dbfd89affc3e tempest-CreateVolumesFromSourceVolumeTest-576925337 None] Lock "cinder-e7a2e4ab-53b2-42e7-98d2-05f1e3678718-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:35 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 0 in 0.966s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:35 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860" returned: 0 in 1.140s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d1e32e-8108-4f13-9601-fc51061e1b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[601702b3-28e9-48f1-a4c1-29217ecb1000]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:35 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:35 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:36 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:44:36 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:36 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:36 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 1 in 1.149s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 1.101s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:37 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88 Jul 07 17:44:37 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:37 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 Jul 07 17:44:37 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:37 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" returned: 0 in 0.833s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:37 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860" returned: 0 in 0.836s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "cinder-quobyte-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88" released by "delete_volume" :: held 3.045s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:37 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860 Jul 07 17:44:37 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Created reservations ['a3726cde-b39a-4840-8397-318b3e724503', 'abbd6281-b5a4-4fc0-b966-3c8b474fe008', 'd84e8151-ceac-42bf-bfd6-742a4aac1eae', '2fc14ab5-1a1d-46b2-80d7-2a79b3a35c9d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:38 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:38 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:38 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c.ca583904-a84b-4dc1-add9-4fd476550860" returned: 0 in 1.008s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-ca583904-a84b-4dc1-add9-4fd476550860" released by "_delete_snapshot" :: held 4.233s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-18d1e32e-8108-4f13-9601-fc51061e1b0c" released by "delete_snapshot" :: held 4.284s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:38 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.965s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:38 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:38 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Deleted volume successfully. Jul 07 17:44:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c488cb96-ba10-4a19-b985-59eeadc95ba8 tempest-VolumeAndVolumeTypeFromImageTest-946699458 None] Lock "cinder-68bfc45e-8b59-4e6b-b0bb-2483bbfacd88-delete_volume" released by "delete_volume" :: held 4.322s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:39 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Created reservations ['69a92860-5978-45f4-9964-dfa21755d534', '2f18d2d2-a0c7-471b-a75a-f9fd66c9c267', 'b84ad920-64a8-40b9-a3c8-d5eb1800f711', '43d32bf7-5fa0-4754-9d9a-062abcd4698f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Delete snapshot completed successfully. Jul 07 17:44:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8fabef10-6a56-4ee4-a942-eaaf79b36522 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-ca583904-a84b-4dc1-add9-4fd476550860-delete_snapshot" released by "delete_snapshot" :: held 4.521s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-18d1e32e-8108-4f13-9601-fc51061e1b0c-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-18d1e32e-8108-4f13-9601-fc51061e1b0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-quobyte-18d1e32e-8108-4f13-9601-fc51061e1b0c" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-18d1e32e-8108-4f13-9601-fc51061e1b0c" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de80bec-6c73-4fec-b64f-3f1034f77866]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:40 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:44:40 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (ab7d005e-bf2c-4677-88f9-a13d1ec65f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9ab4ef-122e-41fa-b993-e17459dc93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9ab4ef-122e-41fa-b993-e17459dc93bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650133381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:40Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a6f9e4-6dcd-4108-8380-e8de81313613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a6f9e4-6dcd-4108-8380-e8de81313613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0505e4f8-71ba-4578-9142-717ce4105e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0505e4f8-71ba-4578-9142-717ce4105e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b', 'volume_name': 'volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bf082e-22a9-4609-84b8-029dbcc63f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bf082e-22a9-4609-84b8-029dbcc63f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89553f9e-69e5-4461-9554-59d9dd3b016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:40 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Volume a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b', 'volume_size': 1} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650133381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:40Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Creating volume a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:40 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:40 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b 1073741824 Jul 07 17:44:40 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:41 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 1.350s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:41 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c Jul 07 17:44:41 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:41 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b 1073741824" returned: 0 in 1.260s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:42 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b Jul 07 17:44:42 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:42 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-18d1e32e-8108-4f13-9601-fc51061e1b0c" returned: 0 in 1.007s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-18d1e32e-8108-4f13-9601-fc51061e1b0c" released by "delete_volume" :: held 2.442s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Created reservations ['056db9c0-c00e-4af8-a80e-4d5a55d5c589', 'df628bc8-3ff1-44a0-b139-415c462c09ef', 'd8afe53c-d55a-4176-90ef-a33628afdd05', '96fc1993-49b7-48de-bc79-c8c9195fa48b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:42 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:42 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:42 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" returned: 0 in 0.811s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89553f9e-69e5-4461-9554-59d9dd3b016b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5024b8e4-62a2-4929-8164-aede50a2bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:42 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Volume volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b (a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b): created successfully Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5024b8e4-62a2-4929-8164-aede50a2bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (ab7d005e-bf2c-4677-88f9-a13d1ec65f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-21dda2f8-90cc-4f84-9d10-8d988a5decfc tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:44:43 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Deleted volume successfully. Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-af9360f3-35fe-4d9d-a198-7a81b6f40b34 tempest-VolumeDependencyTests-450374352 None] Lock "cinder-18d1e32e-8108-4f13-9601-fc51061e1b0c-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-84239f72-2b62-4ab7-97de-1c2623fe9b10-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Lock "cinder-84239f72-2b62-4ab7-97de-1c2623fe9b10-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Acquiring lock "cinder-quobyte-84239f72-2b62-4ab7-97de-1c2623fe9b10" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-84239f72-2b62-4ab7-97de-1c2623fe9b10" acquired by "delete_volume" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbd7e1a-0ebb-40d4-ab02-94d407aa4dd6]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:43 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 Jul 07 17:44:43 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot c6fd5e11-1009-4196-b0c8-b9aeac457e94 of volume a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6547656-3ffe-4e65-892c-707fcf5ee428]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:44 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b Jul 07 17:44:44 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (c2a47f38-27ed-4e90-b32d-d33c3d236b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d95b25b-3ab3-4d53-9257-9e33d80b40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d95b25b-3ab3-4d53-9257-9e33d80b40a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657771485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed78b69-cd92-4efa-bac1-329be105ac81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:45Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f3e9be-2c13-42a0-8cf5-0855dcaed2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f3e9be-2c13-42a0-8cf5-0855dcaed2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a050cf2d-4d68-454c-a816-e6022a443d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a050cf2d-4d68-454c-a816-e6022a443d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed78b69-cd92-4efa-bac1-329be105ac81', 'volume_name': 'volume-aed78b69-cd92-4efa-bac1-329be105ac81', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a484033a-fcf3-4b58-8bfd-ea593de35032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a484033a-fcf3-4b58-8bfd-ea593de35032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dacdfe-5953-4fa2-933c-0faba318d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume aed78b69-cd92-4efa-bac1-329be105ac81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed78b69-cd92-4efa-bac1-329be105ac81', 'volume_size': 1} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:44 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10" returned: 0 in 1.024s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:44 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10 Jul 07 17:44:44 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:45 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" returned: 0 in 0.871s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:45 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 1G Jul 07 17:44:45 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:45 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84239f72-2b62-4ab7-97de-1c2623fe9b10" returned: 0 in 0.728s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Lock "cinder-quobyte-84239f72-2b62-4ab7-97de-1c2623fe9b10" released by "delete_volume" :: held 1.808s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Created reservations ['2af6c979-6503-49c1-b6b8-1a307b5b75b2', 'e62b1600-4c5f-4031-a9a9-1e96065f075f', '348f3865-9d5c-440e-9525-c2efe66494af', 'cca2b080-9c60-40f1-a2d4-5978640e9656'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:45 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:45 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:46 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 1G" returned: 0 in 1.087s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:46 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 Jul 07 17:44:46 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:46 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.972s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:46 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Deleted volume successfully. Jul 07 17:44:46 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=122,cinder:UPDATE=156,cinder:INSERT=40,cinder:DELETE=15 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-0b311a2a-2578-464e-8a25-2061554d653c tempest-VolumeDependencyTests-450374352 None] Lock "cinder-84239f72-2b62-4ab7-97de-1c2623fe9b10-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:47 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94" returned: 0 in 0.767s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:47 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 is being set with open permissions: ugo+rw Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:47 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 Jul 07 17:44:47 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=176,cinder:SELECT=115,cinder:DELETE=15,cinder:INSERT=45 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (4c48fc6e-7732-4e62-8add-bf7b0dccb0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b357f7ea-e4cb-4f86-b76d-83ddb93135c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b357f7ea-e4cb-4f86-b76d-83ddb93135c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908154390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790e2578-1fb6-4d22-b2c7-267dcdd04e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:48Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953668fe-1c4c-489e-9754-807b0ca39fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953668fe-1c4c-489e-9754-807b0ca39fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2dc8e8-bfe3-40aa-9282-03711accff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2dc8e8-bfe3-40aa-9282-03711accff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790e2578-1fb6-4d22-b2c7-267dcdd04e05', 'volume_name': 'volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0466091-f7e3-4a83-9ef7-0e85d32d111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0466091-f7e3-4a83-9ef7-0e85d32d111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a531da-69a8-4e0b-a842-43debe93a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:47 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Volume 790e2578-1fb6-4d22-b2c7-267dcdd04e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05', 'volume_size': 1} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:47 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94" returned: 0 in 0.765s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:47 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info Jul 07 17:44:47 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:48 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info" returned: 0 in 0.695s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:48 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info is being set with open permissions: ugo+rw Jul 07 17:44:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:48 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info Jul 07 17:44:48 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:49 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.info" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.625s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657771485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed78b69-cd92-4efa-bac1-329be105ac81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:45Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating volume aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:49 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:49 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 1073741824 Jul 07 17:44:49 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6684fb18-8e1d-4fe1-acc0-f6d317d60ade tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-c6fd5e11-1009-4196-b0c8-b9aeac457e94-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-c6fd5e11-1009-4196-b0c8-b9aeac457e94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-c6fd5e11-1009-4196-b0c8-b9aeac457e94" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-c6fd5e11-1009-4196-b0c8-b9aeac457e94" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot c6fd5e11-1009-4196-b0c8-b9aeac457e94 of volume a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fce861-37b9-4b97-8c99-bbea1bd284fc]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:49 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 Jul 07 17:44:49 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:50 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 1073741824" returned: 0 in 0.904s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:50 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 Jul 07 17:44:50 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:50 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94" returned: 0 in 0.946s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[0068ae25-3621-4040-916b-541675fa35bb]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:50 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b Jul 07 17:44:50 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:50 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81" returned: 0 in 0.692s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.119s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908154390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790e2578-1fb6-4d22-b2c7-267dcdd04e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:48Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Creating volume 790e2578-1fb6-4d22-b2c7-267dcdd04e05 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:50 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:51 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:51 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 1073741824 Jul 07 17:44:51 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dacdfe-5953-4fa2-933c-0faba318d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed78b69-cd92-4efa-bac1-329be105ac81', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d5062d-9e0a-44c1-9f15-54cf968424be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:51 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume volume-aed78b69-cd92-4efa-bac1-329be105ac81 (aed78b69-cd92-4efa-bac1-329be105ac81): created successfully Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d5062d-9e0a-44c1-9f15-54cf968424be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (c2a47f38-27ed-4e90-b32d-d33c3d236b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-850167eb-2fe4-4be6-ae3c-41b65bd4a7e6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created volume successfully. Jul 07 17:44:51 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" returned: 0 in 0.856s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:51 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 Jul 07 17:44:51 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:52 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 1073741824" returned: 0 in 1.006s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:52 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 Jul 07 17:44:52 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:52 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94" returned: 0 in 0.905s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:52 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94 Jul 07 17:44:52 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:52 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Flow 'volume_create_manager' (469fbbfc-c02f-4420-afea-ea3cc09cad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba56f7e-705c-4f23-a411-643306ad576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.243s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba56f7e-705c-4f23-a411-643306ad576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e94ae58-6825-44f5-a827-58718aae7698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a32b6686c14276bf76825407f37077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:53Z,use_quota=True,user_id='0fc70a318d6c486e85898f878a548f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c399c8d-72ea-439f-9260-922d6c2fd359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c399c8d-72ea-439f-9260-922d6c2fd359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84275e19-0844-48d7-9a47-cc3b232eff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.image.glance [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Creating Keystone auth plugin from conf {{(pid=87251) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating offline snapshot 65da0b45-f659-49b6-aa96-33f9027567c5 of volume aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a531da-69a8-4e0b-a842-43debe93a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f353127-0df1-4c3e-9027-ee72e482191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c636f5ec-91d9-404e-baed-1da2aaf64986]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:52 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Volume volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 (790e2578-1fb6-4d22-b2c7-267dcdd04e05): created successfully Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f353127-0df1-4c3e-9027-ee72e482191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:52 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (4c48fc6e-7732-4e62-8add-bf7b0dccb0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4f3c8094-9044-464c-badf-4adb82d9321f tempest-ProjectReaderTests-126058515 None] Created volume successfully. Jul 07 17:44:53 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 Jul 07 17:44:53 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84275e19-0844-48d7-9a47-cc3b232eff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e94ae58-6825-44f5-a827-58718aae7698', 'volume_name': 'volume-2e94ae58-6825-44f5-a827-58718aae7698', 'volume_size': 1, 'image_id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc8236a7834779893c24cd8879c71e3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39a32b6686c14276bf76825407f37077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43de2b2b08f65e4621d292724730f678bd38d7913e5b3884dc8cd3c693fc97ea253854e3c632adf4043cba298ba477f147abd415dc1693bfa20717a95be2b1d1', 'id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'created_at': datetime.datetime(2026, 7, 7, 15, 44, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35/file', 'properties': {}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73311288-0a18-4ded-b2c0-f4cacc4c183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73311288-0a18-4ded-b2c0-f4cacc4c183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108d4ba-7426-4bd8-b818-00ac46e49d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:53 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Volume 2e94ae58-6825-44f5-a827-58718aae7698: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e94ae58-6825-44f5-a827-58718aae7698', 'volume_size': 1, 'image_id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc8236a7834779893c24cd8879c71e3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39a32b6686c14276bf76825407f37077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43de2b2b08f65e4621d292724730f678bd38d7913e5b3884dc8cd3c693fc97ea253854e3c632adf4043cba298ba477f147abd415dc1693bfa20717a95be2b1d1', 'id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'created_at': datetime.datetime(2026, 7, 7, 15, 44, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35/file', 'properties': {}}, 'image_service': } Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Trying to clone 2e94ae58-6825-44f5-a827-58718aae7698 from image ffdbc6fe-3e81-4886-886a-4775aa05dc35 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'metadata': {}}]). {{(pid=87251) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:44:53 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b.c6fd5e11-1009-4196-b0c8-b9aeac457e94" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:44:53 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-c6fd5e11-1009-4196-b0c8-b9aeac457e94" released by "_delete_snapshot" :: held 3.675s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" released by "delete_snapshot" :: held 3.714s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[231c0352-4c45-4515-a92b-6f4bf5b09027]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Created reservations ['7e95b554-38bf-4d5b-9fad-f12df62ef6ec', '95d886f4-f3de-4516-9036-a7036e4a280a', '320316ba-c928-4ea9-a176-1d31669b55c7', '562a6e0f-3a45-413d-9b65-936a9128edb1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:53 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD Jul 07 17:44:53 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9aa2c408-7e5e-4d3d-b863-7a6028a8ad30 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-c6fd5e11-1009-4196-b0c8-b9aeac457e94-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Lock "cinder-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:54 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81" returned: 0 in 1.171s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea37b446-2e8f-4f41-92ff-15a7d5da969b]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:54 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 1G Jul 07 17:44:54 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:54 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b Jul 07 17:44:54 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:54 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-790e2578-1fb6-4d22-b2c7-267dcdd04e05-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Lock "cinder-790e2578-1fb6-4d22-b2c7-267dcdd04e05-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-quobyte-790e2578-1fb6-4d22-b2c7-267dcdd04e05" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-790e2578-1fb6-4d22-b2c7-267dcdd04e05" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:54 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD Jul 07 17:44:54 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a527d996-b47b-4e29-9f83-0d78f031ca40]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:54 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 Jul 07 17:44:54 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" returned: 0 in 0.912s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:55 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b Jul 07 17:44:55 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 1G" returned: 0 in 1.024s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed78b69-cd92-4efa-bac1-329be105ac81 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:55 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed78b69-cd92-4efa-bac1-329be105ac81 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 Jul 07 17:44:55 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD" returned: 1 in 1.094s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Temporary image ffdbc6fe-3e81-4886-886a-4775aa05dc35 is fetched for user 0fc70a318d6c486e85898f878a548f1a. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f87f3-4212-4c60-801a-d4de2ff107dc]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:55 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05" returned: 0 in 0.955s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:55 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05 Jul 07 17:44:55 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD Jul 07 17:44:55 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" returned: 0 in 0.880s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b" released by "delete_volume" :: held 1.885s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Created reservations ['e8b4bb92-dd0f-4de0-aba0-7c76d99bdd94', 'b6d35471-2725-485f-b93b-5a486c304036', 'ea96de85-1b3a-44b4-9187-738ec7f1085e', '65d1b811-d0de-4da9-a88c-3ac8eabfcc95'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:56 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed78b69-cd92-4efa-bac1-329be105ac81 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5" returned: 0 in 0.931s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:56 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 is being set with open permissions: ugo+rw Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:56 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:56 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:56 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:56 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:56 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-790e2578-1fb6-4d22-b2c7-267dcdd04e05" returned: 0 in 0.942s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-790e2578-1fb6-4d22-b2c7-267dcdd04e05" released by "delete_volume" :: held 1.982s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Created reservations ['200373c5-3314-4e06-a1c9-37d37c078a8c', '8ea9b56e-bef1-469f-9015-6f2115cb7bf3', 'ab6ffc5e-4b35-4b37-9eff-5769b55c5350', '9e90dce2-b158-4716-86b9-eafa038e7895'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:56 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD" returned: 0 in 1.317s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:56 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:44:56 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:57 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.950s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (96d1f4e5-78a1-49e6-902d-494f07c7121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54357df-e001-4453-a74d-960cabfecf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54357df-e001-4453-a74d-960cabfecf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486893389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3055538-6aa7-428b-9615-7dfe2cabfbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:57Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca9118c-32c8-4c58-b816-1f7d4597df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca9118c-32c8-4c58-b816-1f7d4597df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD Jul 07 17:44:57 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c31ec-8bea-4082-bd8e-f04e1b845bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c31ec-8bea-4082-bd8e-f04e1b845bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3055538-6aa7-428b-9615-7dfe2cabfbf6', 'volume_name': 'volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d882197c-c747-4fdd-87b0-8aebf18bf3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d882197c-c747-4fdd-87b0-8aebf18bf3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a0410b-aa57-476e-bc50-b37bda456925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Volume e3055538-6aa7-428b-9615-7dfe2cabfbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6', 'volume_size': 1} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5" returned: 0 in 1.122s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-89208ea5-5458-4148-86fc-df4436d2b73d tempest-ProjectMemberTests-1518515255 None] Lock "cinder-a5853d16-6e2d-47ea-b9d0-93b5b0dcf15b-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:57 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info Jul 07 17:44:57 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (f667cce5-88ad-4e2c-aba7-2896779c316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4bfaa6-b2e2-41f1-8b70-c40b2e0af773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4bfaa6-b2e2-41f1-8b70-c40b2e0af773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306672248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3562d4d2-51e9-4357-9a54-209241330594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:58Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fff4593-634a-495b-9aea-6e4a66505344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fff4593-634a-495b-9aea-6e4a66505344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb7f784-e36e-4f62-902e-00394ba8a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb7f784-e36e-4f62-902e-00394ba8a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3562d4d2-51e9-4357-9a54-209241330594', 'volume_name': 'volume-3562d4d2-51e9-4357-9a54-209241330594', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9deb911-abcd-463a-bec0-550061241ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9deb911-abcd-463a-bec0-550061241ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e259e7a-0c39-4fb6-b883-f23a87cb91cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:57 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Volume 3562d4d2-51e9-4357-9a54-209241330594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3562d4d2-51e9-4357-9a54-209241330594', 'volume_size': 1} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.069s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:57 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Deleted volume successfully. Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d272c8c8-7671-4503-9b2d-75dc5d0f579f tempest-ProjectReaderTests-126058515 None] Lock "cinder-790e2578-1fb6-4d22-b2c7-267dcdd04e05-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:58 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD" returned: 1 in 1.258s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:58 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info" returned: 0 in 0.943s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:58 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info is being set with open permissions: ugo+rw Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:58 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info Jul 07 17:44:58 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:58 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.info" returned: 0 in 0.657s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.003s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486893389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3055538-6aa7-428b-9615-7dfe2cabfbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:57Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Creating volume e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:58 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:44:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:58 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 1073741824 Jul 07 17:44:58 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-99a07700-1177-4bf6-a040-e5819e10e7f7 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Create snapshot completed successfully Jul 07 17:44:59 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 1073741824" returned: 0 in 0.930s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:59 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 Jul 07 17:44:59 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (5dbdc0f8-e0d4-4620-afab-61f077a74f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b54ac57-eac2-46c1-ad0d-0e798bed065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b54ac57-eac2-46c1-ad0d-0e798bed065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-212994948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67ba738-b265-4858-aa1e-b0a9050585e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:00Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3810b76-6953-4690-9c0d-8ec745d4ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3810b76-6953-4690-9c0d-8ec745d4ceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3528aec-f9e1-4255-86a8-719893b9afc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3528aec-f9e1-4255-86a8-719893b9afc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67ba738-b265-4858-aa1e-b0a9050585e4', 'volume_name': 'volume-a67ba738-b265-4858-aa1e-b0a9050585e4', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52dd07d-ca6a-4253-a5b5-a23cbecf0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52dd07d-ca6a-4253-a5b5-a23cbecf0dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b861df-b265-47e3-8c73-94c4d7acd6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume a67ba738-b265-4858-aa1e-b0a9050585e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67ba738-b265-4858-aa1e-b0a9050585e4', 'volume_size': 1} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:00 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6" returned: 0 in 0.819s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306672248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3562d4d2-51e9-4357-9a54-209241330594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:58Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Creating volume 3562d4d2-51e9-4357-9a54-209241330594 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a0410b-aa57-476e-bc50-b37bda456925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 1073741824 Jul 07 17:45:00 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fbdfc0-49fc-4cc4-94f7-faeaf8a7d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Volume volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 (e3055538-6aa7-428b-9615-7dfe2cabfbf6): created successfully Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fbdfc0-49fc-4cc4-94f7-faeaf8a7d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (96d1f4e5-78a1-49e6-902d-494f07c7121f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-aaacf875-dffe-4664-8089-a271f5d32660 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (c35dc165-6eb1-4959-acda-78085fe0293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ebf21e-1d40-4fd3-9ba1-d41330338e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ebf21e-1d40-4fd3-9ba1-d41330338e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-670740687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f409e9-f758-43ba-959b-6df24daf7ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:01Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca64fbd-745d-42a0-9c1e-35bb05fc4ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca64fbd-745d-42a0-9c1e-35bb05fc4ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e020a4-d6bf-4d9f-a7aa-c664df6e63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e020a4-d6bf-4d9f-a7aa-c664df6e63ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f409e9-f758-43ba-959b-6df24daf7ab8', 'volume_name': 'volume-d0f409e9-f758-43ba-959b-6df24daf7ab8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc5b2a3-e2f6-47b6-ad66-6e3ee9cbe8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc5b2a3-e2f6-47b6-ad66-6e3ee9cbe8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24fac1a-c6a7-4d27-afc7-899e85f0c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume d0f409e9-f758-43ba-959b-6df24daf7ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f409e9-f758-43ba-959b-6df24daf7ab8', 'volume_size': 1} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (0a3eeae7-bc49-484c-b09f-abdaee7ff092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc44b4ed-28a5-425f-a876-ad0df163ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc44b4ed-28a5-425f-a876-ad0df163ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101776458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6d6a4e-83bb-4751-af76-e39e384d3ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:01Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af39f93c-1244-4fd8-af8b-097e53d54265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af39f93c-1244-4fd8-af8b-097e53d54265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4214b55-630c-4257-bb45-0bd92228fbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4214b55-630c-4257-bb45-0bd92228fbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6d6a4e-83bb-4751-af76-e39e384d3ea6', 'volume_name': 'volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f58d7ae-a377-4945-8be1-1a22c912bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f58d7ae-a377-4945-8be1-1a22c912bb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e4d99e-6b97-4456-bc74-6db696471882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume ef6d6a4e-83bb-4751-af76-e39e384d3ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6', 'volume_size': 1} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:01 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 1073741824" returned: 0 in 1.306s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:01 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (ba5e4fca-fffc-4f2d-bfc5-eff90abed711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04962939-0ad4-4d6d-a6b8-3fe6a9c8ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04962939-0ad4-4d6d-a6b8-3fe6a9c8ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307904318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948ef494-525d-4faf-a8d5-15a307ea2585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:02Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b03f48-0a15-4f96-b2bf-fe56406262e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b03f48-0a15-4f96-b2bf-fe56406262e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecebc22-22d3-422d-beb3-b3685945ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecebc22-22d3-422d-beb3-b3685945ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948ef494-525d-4faf-a8d5-15a307ea2585', 'volume_name': 'volume-948ef494-525d-4faf-a8d5-15a307ea2585', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ecd6ee-e0e7-4922-9e2f-7efc31345b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ecd6ee-e0e7-4922-9e2f-7efc31345b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd9e94c-42a0-438d-bee8-d57198c54d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume 948ef494-525d-4faf-a8d5-15a307ea2585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948ef494-525d-4faf-a8d5-15a307ea2585', 'volume_size': 1} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:02 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 Jul 07 17:45:02 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (edbf44d8-5c20-4959-8936-25efcd343ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b29fa1f-ebbc-4b86-91a1-da0f94c0c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b29fa1f-ebbc-4b86-91a1-da0f94c0c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306281371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:02Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e94694-20c9-48b3-8917-3d5c38ce820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e94694-20c9-48b3-8917-3d5c38ce820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb77d7f-87da-4fdb-bff1-dbe925bcc3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb77d7f-87da-4fdb-bff1-dbe925bcc3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47', 'volume_name': 'volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c821bf7-d266-45f0-9c2c-a87832582471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c821bf7-d266-45f0-9c2c-a87832582471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5437f74a-76f3-4540-a139-9939794e045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47', 'volume_size': 1} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:02 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594" returned: 0 in 0.769s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.727s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e94ae58-6825-44f5-a827-58718aae7698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a32b6686c14276bf76825407f37077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:53Z,use_quota=True,user_id='0fc70a318d6c486e85898f878a548f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Creating volume 2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:02 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:02 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 1073741824 Jul 07 17:45:02 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e259e7a-0c39-4fb6-b883-f23a87cb91cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3562d4d2-51e9-4357-9a54-209241330594', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792963b8-ac75-4f46-91f3-e212daf62451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Volume volume-3562d4d2-51e9-4357-9a54-209241330594 (3562d4d2-51e9-4357-9a54-209241330594): created successfully Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792963b8-ac75-4f46-91f3-e212daf62451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (f667cce5-88ad-4e2c-aba7-2896779c316f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-97462e03-8da7-42c7-bb71-3ba883628f77 tempest-ProjectReaderTests-126058515 None] Created volume successfully. Jul 07 17:45:03 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 1073741824" returned: 0 in 0.885s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:03 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:03 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-3562d4d2-51e9-4357-9a54-209241330594-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Lock "cinder-3562d4d2-51e9-4357-9a54-209241330594-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-quobyte-3562d4d2-51e9-4357-9a54-209241330594" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-3562d4d2-51e9-4357-9a54-209241330594" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e95912-494e-427d-bc5d-f1480cc0d3c9]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:04 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:04 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 Jul 07 17:45:04 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 0 in 0.671s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.874s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-212994948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67ba738-b265-4858-aa1e-b0a9050585e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:00Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating volume a67ba738-b265-4858-aa1e-b0a9050585e4 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:04 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:04 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 1073741824 Jul 07 17:45:04 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Attempting download of ffdbc6fe-3e81-4886-886a-4775aa05dc35 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'metadata': {}}])) to volume 2e94ae58-6825-44f5-a827-58718aae7698. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2129dbc0-1b50-4232-b780-0c5d7ea02ae5]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:04 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk Jul 07 17:45:04 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594" returned: 0 in 0.831s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:05 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594 Jul 07 17:45:05 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk" returned: 0 in 0.820s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:05 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 1073741824" returned: 0 in 1.036s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk Jul 07 17:45:05 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:05 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 Jul 07 17:45:05 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-3562d4d2-51e9-4357-9a54-209241330594" returned: 0 in 0.723s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-3562d4d2-51e9-4357-9a54-209241330594" released by "delete_volume" :: held 1.614s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:05 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Created reservations ['df505554-f19d-4e7f-903c-cc88a2540a59', 'bc54902a-b4f4-4db4-a483-6fbc19828b90', '7edbc653-5e97-4b12-9615-afa5731e9979', 'cf678f5c-58e6-497e-82f5-177349259282'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:06 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:06 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:06 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk" returned: 1 in 0.802s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffdbc6fe-3e81-4886-886a-4775aa05dc35_2hcdj2qk' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2f266-02d4-49a8-b43b-64d18d8859d1]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:06 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4" returned: 0 in 0.663s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.069s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-670740687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f409e9-f758-43ba-959b-6df24daf7ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:01Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating volume d0f409e9-f758-43ba-959b-6df24daf7ab8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:06 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b861df-b265-47e3-8c73-94c4d7acd6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67ba738-b265-4858-aa1e-b0a9050585e4', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:06 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 1073741824 Jul 07 17:45:06 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ca1f97-0771-4e18-a60b-1d8b38a2f1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:06 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume volume-a67ba738-b265-4858-aa1e-b0a9050585e4 (a67ba738-b265-4858-aa1e-b0a9050585e4): created successfully Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ca1f97-0771-4e18-a60b-1d8b38a2f1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (5dbdc0f8-e0d4-4620-afab-61f077a74f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:06 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD Jul 07 17:45:06 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2babccde-3f0c-4b6a-88bd-93be67f31ca6 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created volume successfully. Jul 07 17:45:06 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.915s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:06 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:06 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Deleted volume successfully. Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f7ae0f35-445c-4bcb-8e8d-a880e12e1d31 tempest-ProjectReaderTests-126058515 None] Lock "cinder-3562d4d2-51e9-4357-9a54-209241330594-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:07 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (cd4f7392-e037-4ed5-92de-0cf7b4a5a81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e84d69-e2ca-4c56-bbb6-c589ea6cf4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e84d69-e2ca-4c56-bbb6-c589ea6cf4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844371861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150b7b10-ba29-4af9-b757-f16b44ac3586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:07Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18232973-896f-4543-9fca-f61e10ead728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:07 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD Jul 07 17:45:07 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18232973-896f-4543-9fca-f61e10ead728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0860048c-bc50-4413-ae33-8515300a8654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0860048c-bc50-4413-ae33-8515300a8654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150b7b10-ba29-4af9-b757-f16b44ac3586', 'volume_name': 'volume-150b7b10-ba29-4af9-b757-f16b44ac3586', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16ba845-5892-4380-8927-a3a7fb7a31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16ba845-5892-4380-8927-a3a7fb7a31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0479e0bc-f55c-4212-b2cc-3f98cc317fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:07 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Volume 150b7b10-ba29-4af9-b757-f16b44ac3586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150b7b10-ba29-4af9-b757-f16b44ac3586', 'volume_size': 1} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:07 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 1073741824" returned: 0 in 1.053s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:07 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 Jul 07 17:45:07 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:07 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD" returned: 1 in 0.903s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] ffdbc6fe-3e81-4886-886a-4775aa05dc35 was raw, converting to raw {{(pid=87251) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:45:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:08 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8" returned: 0 in 0.668s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.309s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101776458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6d6a4e-83bb-4751-af76-e39e384d3ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:01Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating volume ef6d6a4e-83bb-4751-af76-e39e384d3ea6 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:08 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:08 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:08 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24fac1a-c6a7-4d27-afc7-899e85f0c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f409e9-f758-43ba-959b-6df24daf7ab8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:08 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 1073741824 Jul 07 17:45:08 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a1d2e0-52a7-446a-8859-516c9d25991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:08 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 (d0f409e9-f758-43ba-959b-6df24daf7ab8): created successfully Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a1d2e0-52a7-446a-8859-516c9d25991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (c35dc165-6eb1-4959-acda-78085fe0293d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:08 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-646a5bd8-5fe3-4a65-a349-1096c5493965 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created volume successfully. Jul 07 17:45:08 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 0 in 0.844s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ffdbc6fe-3e81-4886-886a-4775aa05dc35_a3m1kfgfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:45:08 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:45:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:08 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 1G Jul 07 17:45:08 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:09 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 1073741824" returned: 0 in 1.227s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:09 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 Jul 07 17:45:09 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:09 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 1G" returned: 0 in 0.814s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef2ca02-2286-4b2f-8eb2-03b2a74e2e2e]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:09 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:09 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:10 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6" returned: 0 in 0.766s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.363s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e4d99e-6b97-4456-bc74-6db696471882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dfc3a8-41e7-4f2a-a695-fcacae98858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot 50381c13-98da-4a15-85a2-4750d66b9aad of volume e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:45:10 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 (ef6d6a4e-83bb-4751-af76-e39e384d3ea6): created successfully Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dfc3a8-41e7-4f2a-a695-fcacae98858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (0a3eeae7-bc49-484c-b09f-abdaee7ff092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f2a0da-f7b6-47af-ba13-c009991a8470]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4919b1b4-6063-438b-8f3d-c78872f84b30 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created volume successfully. Jul 07 17:45:10 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 Jul 07 17:45:10 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:10 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 0 in 0.933s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:10 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:10 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:11 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6" returned: 0 in 1.033s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:11 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad 1G Jul 07 17:45:11 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:11 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 1 in 0.936s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Downloaded image ffdbc6fe-3e81-4886-886a-4775aa05dc35 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'metadata': {}}])) to volume 2e94ae58-6825-44f5-a827-58718aae7698 successfully. {{(pid=87251) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Temporary image ffdbc6fe-3e81-4886-886a-4775aa05dc35 for user 0fc70a318d6c486e85898f878a548f1a is deleted. {{(pid=87251) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.volume_utils [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Marking volume 2e94ae58-6825-44f5-a827-58718aae7698 as bootable. {{(pid=87251) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Copying metadata from image ffdbc6fe-3e81-4886-886a-4775aa05dc35 to 2e94ae58-6825-44f5-a827-58718aae7698. {{(pid=87251) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Creating volume glance metadata for volume 2e94ae58-6825-44f5-a827-58718aae7698 backed by image ffdbc6fe-3e81-4886-886a-4775aa05dc35 with: {'image_id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fc8236a7834779893c24cd8879c71e3a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87251) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108d4ba-7426-4bd8-b818-00ac46e49d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e94ae58-6825-44f5-a827-58718aae7698', 'volume_size': 1, 'image_id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc8236a7834779893c24cd8879c71e3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39a32b6686c14276bf76825407f37077', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43de2b2b08f65e4621d292724730f678bd38d7913e5b3884dc8cd3c693fc97ea253854e3c632adf4043cba298ba477f147abd415dc1693bfa20717a95be2b1d1', 'id': 'ffdbc6fe-3e81-4886-886a-4775aa05dc35', 'created_at': datetime.datetime(2026, 7, 7, 15, 44, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffdbc6fe-3e81-4886-886a-4775aa05dc35/file', 'properties': {}}, 'image_service': }' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adefd16a-b28f-4288-b2d0-62bc361130c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:11 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Volume volume-2e94ae58-6825-44f5-a827-58718aae7698 (2e94ae58-6825-44f5-a827-58718aae7698): created successfully Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adefd16a-b28f-4288-b2d0-62bc361130c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:11 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Flow 'volume_create_manager' (469fbbfc-c02f-4420-afea-ea3cc09cad98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-17e6c3e9-e739-4a1b-b6e4-fa36c5e9af9c tempest-VolumeImageDependencyTests-612025200 None] Created volume successfully. Jul 07 17:45:12 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad 1G" returned: 0 in 1.062s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:12 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad Jul 07 17:45:12 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Acquiring lock "cinder-2e94ae58-6825-44f5-a827-58718aae7698-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Lock "cinder-2e94ae58-6825-44f5-a827-58718aae7698-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Acquiring lock "cinder-quobyte-2e94ae58-6825-44f5-a827-58718aae7698" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Lock "cinder-quobyte-2e94ae58-6825-44f5-a827-58718aae7698" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c96d302-ece5-4da4-a972-2c547090e82a]: (4, 'raw') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:12 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:12 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:13 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad" returned: 0 in 0.954s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:13 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad is being set with open permissions: ugo+rw Jul 07 17:45:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:13 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad Jul 07 17:45:13 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:13 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 0 in 1.012s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:13 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:13 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:14 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad" returned: 0 in 0.839s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:14 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info Jul 07 17:45:14 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:14 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 1 in 0.810s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698' failed. Not Retrying. {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:14 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698 Jul 07 17:45:14 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:14 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info" returned: 0 in 0.756s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:14 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info is being set with open permissions: ugo+rw Jul 07 17:45:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:14 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info Jul 07 17:45:14 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:15 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-2e94ae58-6825-44f5-a827-58718aae7698" returned: 0 in 0.678s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Lock "cinder-quobyte-2e94ae58-6825-44f5-a827-58718aae7698" released by "delete_volume" :: held 2.580s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Created reservations ['f28fa81b-c442-4bb9-91f5-e57099b63eaf', 'e22b25e1-af5f-4f1e-bea1-add7c8193b5c', '0c9cf6a8-d9cc-4a15-b6be-7ed054b6e79a', 'e5ee7bad-400b-48fd-962c-bd9b1659b737'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:15 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:15 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:15 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.info" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.508s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.531s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307904318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948ef494-525d-4faf-a8d5-15a307ea2585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:02Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating volume 948ef494-525d-4faf-a8d5-15a307ea2585 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:15 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:15 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 1073741824 Jul 07 17:45:15 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:15 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5ce3c72d-b344-419a-982a-5489d8afa235 tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:45:16 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Deleted volume successfully. Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ba247873-191d-494d-8351-b4a28cfd6c51 tempest-VolumeImageDependencyTests-612025200 None] Lock "cinder-2e94ae58-6825-44f5-a827-58718aae7698-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-50381c13-98da-4a15-85a2-4750d66b9aad-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-50381c13-98da-4a15-85a2-4750d66b9aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-e3055538-6aa7-428b-9615-7dfe2cabfbf6" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-e3055538-6aa7-428b-9615-7dfe2cabfbf6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-50381c13-98da-4a15-85a2-4750d66b9aad" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-50381c13-98da-4a15-85a2-4750d66b9aad" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot 50381c13-98da-4a15-85a2-4750d66b9aad of volume e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3355bac1-02f1-4be4-93ea-f16b66a985a4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:16 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad Jul 07 17:45:16 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:16 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 1073741824" returned: 0 in 1.066s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:16 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 Jul 07 17:45:16 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:17 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad" returned: 0 in 0.938s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb153af-6ea8-4ba6-ae84-c63e88b5bc35]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:17 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585" returned: 0 in 0.819s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.041s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306281371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afcffbc36114b18a5d66bdfd77a8b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:02Z,use_quota=True,user_id='663fffbcb7e844a3aa5b79bf95d39a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Creating volume aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:17 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:17 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 Jul 07 17:45:17 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:17 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 1073741824 Jul 07 17:45:17 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd9e94c-42a0-438d-bee8-d57198c54d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948ef494-525d-4faf-a8d5-15a307ea2585', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f366a91-d1a5-4adf-b22f-b685af87a08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume volume-948ef494-525d-4faf-a8d5-15a307ea2585 (948ef494-525d-4faf-a8d5-15a307ea2585): created successfully Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f366a91-d1a5-4adf-b22f-b685af87a08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (ba5e4fca-fffc-4f2d-bfc5-eff90abed711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f460ad32-5008-4b39-a2b4-81833d9e7e3c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created volume successfully. Jul 07 17:45:18 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6" returned: 0 in 0.980s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:18 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad Jul 07 17:45:18 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:18 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 1073741824" returned: 0 in 1.063s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:18 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 Jul 07 17:45:18 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:19 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad" returned: 0 in 0.903s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:19 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad Jul 07 17:45:19 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:19 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47" returned: 0 in 0.847s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.256s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844371861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150b7b10-ba29-4af9-b757-f16b44ac3586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:07Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Creating volume 150b7b10-ba29-4af9-b757-f16b44ac3586 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:19 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5437f74a-76f3-4540-a139-9939794e045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b02cb9-d079-4af5-80b4-9d8e0364cef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:19 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 1073741824 Jul 07 17:45:19 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:19 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Volume volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 (aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47): created successfully Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b02cb9-d079-4af5-80b4-9d8e0364cef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Flow 'volume_create_manager' (edbf44d8-5c20-4959-8936-25efcd343ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ccc968af-dc95-42d9-952e-65ea8dc4894b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created volume successfully. Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47" acquired by "delete_volume" :: waited 0.025s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:20 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6.50381c13-98da-4a15-85a2-4750d66b9aad" returned: 0 in 0.858s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b11ed7-8ecf-4107-be43-544ba7cbec62]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-50381c13-98da-4a15-85a2-4750d66b9aad" released by "_delete_snapshot" :: held 3.843s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-e3055538-6aa7-428b-9615-7dfe2cabfbf6" released by "delete_snapshot" :: held 3.879s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:20 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 Jul 07 17:45:20 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Created reservations ['80a44b51-c66d-4817-8e46-bb3f95bc6dad', 'c0227c2d-18f0-451a-8fd2-ea679208c060', '3330968a-ddb6-407b-9425-9ac7251382d6', 'a16370a6-413b-48e2-93dd-f3b28d10cb68'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-232386bb-caf6-4970-86a8-485800714154 tempest-ProjectAdminTests-155080283 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540245056152, 'free_capacity_gb': 1775.7540245056152, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87251) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:45:20 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ca7f2492-58a2-4aee-8fd6-b817e7e4cc94 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-50381c13-98da-4a15-85a2-4750d66b9aad-delete_snapshot" released by "delete_snapshot" :: held 4.109s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:20 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 1073741824" returned: 0 in 1.070s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-e3055538-6aa7-428b-9615-7dfe2cabfbf6-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:20 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 Jul 07 17:45:20 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-e3055538-6aa7-428b-9615-7dfe2cabfbf6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-e3055538-6aa7-428b-9615-7dfe2cabfbf6" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-e3055538-6aa7-428b-9615-7dfe2cabfbf6" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbe5caa-6404-4b6c-9192-3826e4b22976]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:20 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 Jul 07 17:45:20 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:21 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47" returned: 0 in 0.969s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:21 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47 Jul 07 17:45:21 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:21 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586" returned: 0 in 0.875s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0479e0bc-f55c-4212-b2cc-3f98cc317fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150b7b10-ba29-4af9-b757-f16b44ac3586', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9080fde-70da-4f92-ad7e-7bc4a0b04940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:21 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Volume volume-150b7b10-ba29-4af9-b757-f16b44ac3586 (150b7b10-ba29-4af9-b757-f16b44ac3586): created successfully Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9080fde-70da-4f92-ad7e-7bc4a0b04940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (cd4f7392-e037-4ed5-92de-0cf7b4a5a81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-94d9f898-3dee-4573-b4fe-a3682aef434d tempest-ProjectReaderTests-126058515 None] Created volume successfully. Jul 07 17:45:21 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6" returned: 0 in 0.987s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:21 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6 Jul 07 17:45:21 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:21 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47" returned: 0 in 0.841s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47" released by "delete_volume" :: held 1.903s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['32578903-515a-48f0-96c0-3562de27a1ec', 'bd28c4de-56e9-4fe0-8303-637077ec4379', '02f28ef1-5cc6-4238-acf6-6c48a89e3c07', 'be607a0c-5a6c-4f9e-810c-6418874cb2d3'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:22 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:22 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-948ef494-525d-4faf-a8d5-15a307ea2585-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-948ef494-525d-4faf-a8d5-15a307ea2585-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-948ef494-525d-4faf-a8d5-15a307ea2585" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-948ef494-525d-4faf-a8d5-15a307ea2585" acquired by "delete_volume" :: waited 0.043s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be5107-d562-4e1c-8820-5222e345d4ce]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-150b7b10-ba29-4af9-b757-f16b44ac3586-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Lock "cinder-150b7b10-ba29-4af9-b757-f16b44ac3586-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:22 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 Jul 07 17:45:22 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-quobyte-150b7b10-ba29-4af9-b757-f16b44ac3586" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-150b7b10-ba29-4af9-b757-f16b44ac3586" acquired by "delete_volume" :: waited 0.037s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710df0e-a38f-4996-8de0-d43dd2da1084]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:22 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e3055538-6aa7-428b-9615-7dfe2cabfbf6" returned: 0 in 1.141s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-e3055538-6aa7-428b-9615-7dfe2cabfbf6" released by "delete_volume" :: held 2.220s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:23 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Created reservations ['3539555e-c91f-4f62-bb83-c287c92deba4', '8b2a37e7-5450-486f-86c3-415075bbeb38', '0bb57e4d-974c-43e7-9882-4136d041767d', '8a02b931-20d3-4ca8-8dda-c68e2519ef9c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:23 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:23 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.946s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:23 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleted volume successfully. Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-4d117031-ed41-45bc-a608-0428be20b509 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-aeb6dfc3-8ecc-42b5-ac2b-0c4112ab3b47-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:23 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:23 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:23 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585" returned: 0 in 1.117s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:23 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585 Jul 07 17:45:23 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:24 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586" returned: 0 in 1.116s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:24 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586 Jul 07 17:45:24 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:24 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.893s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-6ac2af61-e422-4c80-b9f3-84ef0ece4c81 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-e3055538-6aa7-428b-9615-7dfe2cabfbf6-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:24 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-948ef494-525d-4faf-a8d5-15a307ea2585" returned: 0 in 0.944s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-948ef494-525d-4faf-a8d5-15a307ea2585" released by "delete_volume" :: held 2.160s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['e4a27ced-1d41-47a2-bd3c-76388bfb9843', '040c5e53-9293-4ca6-a23b-f73c41f3f7e2', 'acb2a5de-fdcb-46c5-99c1-df536bc5a059', 'a0151f46-12dd-4e55-9733-35fa22548869'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (c0656359-2863-44fb-8cb5-b1e73e88a5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f4c310-e42e-4a76-9992-12fe359a1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f4c310-e42e-4a76-9992-12fe359a1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1170322898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b47841-f3ba-46b3-9e1e-122a56051fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:25Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:24 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb1e510-dd3e-46e4-9e76-0764b220f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb1e510-dd3e-46e4-9e76-0764b220f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb564993-2f9c-450f-96ec-dfe192e2b931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb564993-2f9c-450f-96ec-dfe192e2b931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b47841-f3ba-46b3-9e1e-122a56051fe9', 'volume_name': 'volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da28920-730d-4bc9-be6e-c55762162735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da28920-730d-4bc9-be6e-c55762162735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46371ddb-c613-45d5-93f1-cc6819974422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:24 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Volume f3b47841-f3ba-46b3-9e1e-122a56051fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9', 'volume_size': 1} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1170322898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b47841-f3ba-46b3-9e1e-122a56051fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:25Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Creating volume f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:24 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-150b7b10-ba29-4af9-b757-f16b44ac3586" returned: 0 in 0.977s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:24 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 1073741824 Jul 07 17:45:24 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-150b7b10-ba29-4af9-b757-f16b44ac3586" released by "delete_volume" :: held 2.182s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:25 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:25 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Created reservations ['0c2deee4-bed9-47da-b4d9-ff074fabaefb', '405b1824-d43f-440b-a6f3-6cb4275fe34a', '23d1acfe-12ad-48a6-8763-f81b55b8237b', '55272a08-3a05-43ea-a871-389fb5794899'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:25 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:25 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-ef6d6a4e-83bb-4751-af76-e39e384d3ea6-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-ef6d6a4e-83bb-4751-af76-e39e384d3ea6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-ef6d6a4e-83bb-4751-af76-e39e384d3ea6" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-ef6d6a4e-83bb-4751-af76-e39e384d3ea6" acquired by "delete_volume" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b974bcd-0bb4-4265-bf83-9576973ebdb8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:26 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.092s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleted volume successfully. Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ff1cfc5f-d370-4186-8558-0846b9c1201a tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-948ef494-525d-4faf-a8d5-15a307ea2585-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:26 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 Jul 07 17:45:26 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:26 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 1073741824" returned: 0 in 1.227s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:26 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.006s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Deleted volume successfully. Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-746fe2d9-f297-4bd8-b719-9deb6193a9cb tempest-ProjectReaderTests-126058515 None] Lock "cinder-150b7b10-ba29-4af9-b757-f16b44ac3586-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:26 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 Jul 07 17:45:26 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (5e4914e9-6321-4726-b801-c53920d36d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2cb2c7-a872-41b8-a31f-666c51e6cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2cb2c7-a872-41b8-a31f-666c51e6cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010757973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee2624-08e3-46fb-ac8f-9c8327a6c03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:27Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56207be-4794-4f7f-8be1-2acc0672dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56207be-4794-4f7f-8be1-2acc0672dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc07dc7-e00e-46da-8f97-3fd194c91974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc07dc7-e00e-46da-8f97-3fd194c91974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beee2624-08e3-46fb-ac8f-9c8327a6c03f', 'volume_name': 'volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3254fc2d-d47f-48c8-a9e7-e8f85eff4e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3254fc2d-d47f-48c8-a9e7-e8f85eff4e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87384f30-60f6-40f6-8203-8e7fc440209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:26 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Volume beee2624-08e3-46fb-ac8f-9c8327a6c03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f', 'volume_size': 1} Jul 07 17:45:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:27 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6" returned: 0 in 1.105s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:27 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6 Jul 07 17:45:27 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:27 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9" returned: 0 in 0.847s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010757973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee2624-08e3-46fb-ac8f-9c8327a6c03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e5e79686574e3a8e00add0b27f4ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:27Z,use_quota=True,user_id='fb7e4ca0584941b58cd8ff08981af95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Creating volume beee2624-08e3-46fb-ac8f-9c8327a6c03f {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:27 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:27 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f 1073741824 Jul 07 17:45:27 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46371ddb-c613-45d5-93f1-cc6819974422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0efaa1-ed89-4b83-ac24-d1304598cf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:27 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Volume volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 (f3b47841-f3ba-46b3-9e1e-122a56051fe9): created successfully Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0efaa1-ed89-4b83-ac24-d1304598cf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (c0656359-2863-44fb-8cb5-b1e73e88a5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-05ee84f6-c505-45b1-9d88-022cc9343fe5 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:45:27 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-ef6d6a4e-83bb-4751-af76-e39e384d3ea6" returned: 0 in 0.768s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-ef6d6a4e-83bb-4751-af76-e39e384d3ea6" released by "delete_volume" :: held 1.928s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:27 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['c2e45de3-0062-4739-9a16-54e598e50e45', 'a8d63b7f-58fd-434c-9fe6-bc97f7f5724d', '6a8fa7ae-51f1-48cb-8b3c-b2c5d5c91ec5', 'c757d07a-3fba-412e-8b1a-db246f8bab3f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:28 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:28 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-d0f409e9-f758-43ba-959b-6df24daf7ab8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:28 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f 1073741824" returned: 0 in 1.025s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-d0f409e9-f758-43ba-959b-6df24daf7ab8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:28 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f Jul 07 17:45:28 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-d0f409e9-f758-43ba-959b-6df24daf7ab8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-d0f409e9-f758-43ba-959b-6df24daf7ab8" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e64437-eab2-410d-b7d5-56cd658d75ec]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:28 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 Jul 07 17:45:28 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:28 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.809s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleted volume successfully. Jul 07 17:45:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-634b60df-aa2b-4ac3-813c-76d6ba53594c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-ef6d6a4e-83bb-4751-af76-e39e384d3ea6-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:29 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f" returned: 0 in 0.765s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.744s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot e58d2c69-4cee-414b-99ff-c843ceac8bb7 of volume f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87384f30-60f6-40f6-8203-8e7fc440209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c62de1d-7b5f-485f-9bbf-cceb4c89886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f931f37-0117-4101-883d-e3cdb1e6354a]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:29 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Volume volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f (beee2624-08e3-46fb-ac8f-9c8327a6c03f): created successfully Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c62de1d-7b5f-485f-9bbf-cceb4c89886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Flow 'volume_create_manager' (5e4914e9-6321-4726-b801-c53920d36d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:29 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2a6db253-eb89-4de7-a41f-9182c62a76f2 tempest-ProjectReaderTests-126058515 None] Created volume successfully. Jul 07 17:45:29 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 Jul 07 17:45:29 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:29 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8" returned: 0 in 0.934s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:29 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8 Jul 07 17:45:29 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:29 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9" returned: 0 in 0.854s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:29 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 1G Jul 07 17:45:29 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-beee2624-08e3-46fb-ac8f-9c8327a6c03f-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Lock "cinder-beee2624-08e3-46fb-ac8f-9c8327a6c03f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:30 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-d0f409e9-f758-43ba-959b-6df24daf7ab8" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-d0f409e9-f758-43ba-959b-6df24daf7ab8" released by "delete_volume" :: held 1.763s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Acquiring lock "cinder-quobyte-beee2624-08e3-46fb-ac8f-9c8327a6c03f" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-beee2624-08e3-46fb-ac8f-9c8327a6c03f" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4c55eb-7106-4605-9fd2-452a6fe41bbd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['ddb2f08a-b27f-4cb7-b597-874ddce12711', '20c791d4-c9be-4014-bd5f-7b3a44ad224e', 'b1f2c78f-4348-4954-a777-215176ca0a8e', '90009b7c-00e7-4702-8ed3-96680a8a9c33'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:30 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:30 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:30 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f Jul 07 17:45:30 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-a67ba738-b265-4858-aa1e-b0a9050585e4-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-a67ba738-b265-4858-aa1e-b0a9050585e4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-a67ba738-b265-4858-aa1e-b0a9050585e4" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-a67ba738-b265-4858-aa1e-b0a9050585e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc8209-e097-4e0b-9a5f-90feab8e8a58]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:30 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 Jul 07 17:45:30 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:30 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 1G" returned: 0 in 1.035s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:31 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 Jul 07 17:45:31 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:31 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.852s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:31 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleted volume successfully. Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-d2f3b68a-8c38-446b-b030-6b8a7a7d6e9c tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-d0f409e9-f758-43ba-959b-6df24daf7ab8-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:31 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f" returned: 0 in 1.315s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:31 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f Jul 07 17:45:31 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:31 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4" returned: 0 in 0.984s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:31 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4 Jul 07 17:45:31 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:32 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7" returned: 0 in 1.123s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:32 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 is being set with open permissions: ugo+rw Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:32 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 Jul 07 17:45:32 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:32 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-beee2624-08e3-46fb-ac8f-9c8327a6c03f" returned: 0 in 0.798s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Lock "cinder-quobyte-beee2624-08e3-46fb-ac8f-9c8327a6c03f" released by "delete_volume" :: held 2.184s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Created reservations ['0470f145-bcf1-4587-8b57-0051fbc10c1e', '27f6cfb9-cd7d-4d4f-9640-dfc3b552ce88', '602f2939-97c7-401e-8bfa-cbda37c04093', '682739dd-8a95-4453-acb5-9f5287ff4b07'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:32 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a67ba738-b265-4858-aa1e-b0a9050585e4" returned: 0 in 0.791s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-a67ba738-b265-4858-aa1e-b0a9050585e4" released by "delete_volume" :: held 1.850s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['cecd85e3-9506-4ca1-aa13-19f009758e64', '2148956b-9c2c-478e-ad90-b3278b615221', 'de87faac-52a6-41ad-a629-22c32f3baf75', '74780b15-975d-4f0b-bc4c-252908c5279b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:32 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:32 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:32 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:32 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-65da0b45-f659-49b6-aa96-33f9027567c5-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:32 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:32 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-65da0b45-f659-49b6-aa96-33f9027567c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-aed78b69-cd92-4efa-bac1-329be105ac81" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-aed78b69-cd92-4efa-bac1-329be105ac81" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-65da0b45-f659-49b6-aa96-33f9027567c5" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-65da0b45-f659-49b6-aa96-33f9027567c5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleting offline snapshot 65da0b45-f659-49b6-aa96-33f9027567c5 of volume aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:45:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] snapshot_file for this snap is: volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[354640ed-f2c6-4f2d-8156-36970a4fa9c7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:33 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 Jul 07 17:45:33 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:33 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7" returned: 0 in 1.101s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:33 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info Jul 07 17:45:33 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:33 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.288s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:33 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Deleted volume successfully. Jul 07 17:45:33 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-ceb1d27a-817c-4f18-a2aa-b894ed4c0bc7 tempest-ProjectReaderTests-126058515 None] Lock "cinder-beee2624-08e3-46fb-ac8f-9c8327a6c03f-delete_volume" released by "delete_volume" :: held 3.877s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:34 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.338s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:34 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleted volume successfully. Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-9527e958-5606-4da0-ace6-32a1317efa11 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-a67ba738-b265-4858-aa1e-b0a9050585e4-delete_volume" released by "delete_volume" :: held 3.556s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:34 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 1.568s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:45:34 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info" returned: 0 in 1.121s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:34 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info is being set with open permissions: ugo+rw Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:34 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info Jul 07 17:45:34 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:34 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5" returned: 0 in 1.493s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed78b69-cd92-4efa-bac1-329be105ac81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd14c14e-e030-43aa-8230-dff1e22e40fd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:34 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 Jul 07 17:45:34 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:35 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.info" returned: 0 in 0.916s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.315s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-aec3fd15-4355-4444-8ea6-94181b5eee9f tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:45:35 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81" returned: 0 in 0.994s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:35 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 Jul 07 17:45:35 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-e58d2c69-4cee-414b-99ff-c843ceac8bb7-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-e58d2c69-4cee-414b-99ff-c843ceac8bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-f3b47841-f3ba-46b3-9e1e-122a56051fe9" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-f3b47841-f3ba-46b3-9e1e-122a56051fe9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-e58d2c69-4cee-414b-99ff-c843ceac8bb7" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-e58d2c69-4cee-414b-99ff-c843ceac8bb7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot e58d2c69-4cee-414b-99ff-c843ceac8bb7 of volume f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7571c83c-32ec-420e-860c-01cfa597a39d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:36 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 Jul 07 17:45:36 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:36 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5" returned: 0 in 0.952s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:36 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5 Jul 07 17:45:36 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:36 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7" returned: 0 in 1.037s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a435bcb0-c59e-4c94-93a9-92e6af553c77]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:37 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 Jul 07 17:45:37 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Flow 'volume_create_manager' (f4c4030a-43f5-42de-9937-fdcb79f7a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ae80a-3dca-47c1-81d5-10c15e35349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ae80a-3dca-47c1-81d5-10c15e35349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164967058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72fba5d-10df-4d9b-8f06-0918b606d1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced370955b97451a8d9af98d64c1a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:37Z,use_quota=True,user_id='2268b16b7d2348099cd17bfb2117d954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ae50be-5932-414b-a454-67b0aeb03594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ae50be-5932-414b-a454-67b0aeb03594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b1ad76-7bd5-4756-9ae6-c18086abc0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b1ad76-7bd5-4756-9ae6-c18086abc0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72fba5d-10df-4d9b-8f06-0918b606d1c8', 'volume_name': 'volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d125912-6fd3-48ae-be23-a197ea63b5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d125912-6fd3-48ae-be23-a197ea63b5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:37 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74dd9e3-ab49-4092-8024-ff4ac4d89ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:37 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Volume e72fba5d-10df-4d9b-8f06-0918b606d1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8', 'volume_size': 1} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164967058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72fba5d-10df-4d9b-8f06-0918b606d1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced370955b97451a8d9af98d64c1a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:37Z,use_quota=True,user_id='2268b16b7d2348099cd17bfb2117d954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Creating volume e72fba5d-10df-4d9b-8f06-0918b606d1c8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:37 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81.65da0b45-f659-49b6-aa96-33f9027567c5" returned: 0 in 0.847s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:37 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 1073741824 Jul 07 17:45:37 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-65da0b45-f659-49b6-aa96-33f9027567c5" released by "_delete_snapshot" :: held 4.452s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-aed78b69-cd92-4efa-bac1-329be105ac81" released by "delete_snapshot" :: held 4.491s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['b8dafd35-e5fc-4cc5-a03d-2dc3f7da78ab', 'a8308e0e-3c14-4a03-b0b5-dad574d5bb6f', 'cb9efd7a-11b3-4dee-9e74-a9a3cf7029a0', 'd9ba8ecd-ddb0-4b73-9ac0-e90a76f7c931'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Delete snapshot completed successfully. Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-09b4a4fd-37ef-498e-b674-266d493c99a3 tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-65da0b45-f659-49b6-aa96-33f9027567c5-delete_snapshot" released by "delete_snapshot" :: held 4.668s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:37 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9" returned: 0 in 0.859s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:37 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 Jul 07 17:45:37 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-aed78b69-cd92-4efa-bac1-329be105ac81-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:38 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 1073741824" returned: 0 in 0.988s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-aed78b69-cd92-4efa-bac1-329be105ac81-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "cinder-quobyte-aed78b69-cd92-4efa-bac1-329be105ac81" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:38 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 Jul 07 17:45:38 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-aed78b69-cd92-4efa-bac1-329be105ac81" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce836557-3f2a-4bff-8a2c-fe826fa7d9b8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:38 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 Jul 07 17:45:38 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:38 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7" returned: 0 in 0.904s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:38 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7 Jul 07 17:45:38 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:39 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8" returned: 0 in 0.749s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74dd9e3-ab49-4092-8024-ff4ac4d89ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f967c9-e608-4727-b5e2-b8157f20feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:39 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Volume volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 (e72fba5d-10df-4d9b-8f06-0918b606d1c8): created successfully Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f967c9-e608-4727-b5e2-b8157f20feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Flow 'volume_create_manager' (f4c4030a-43f5-42de-9937-fdcb79f7a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-149d64c9-3682-4ca3-a4f5-cce23c3920bc tempest-ProjectReaderTests-719546489 None] Created volume successfully. Jul 07 17:45:39 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81" returned: 0 in 0.918s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:39 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81 Jul 07 17:45:39 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:39 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9.e58d2c69-4cee-414b-99ff-c843ceac8bb7" returned: 0 in 0.686s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-e58d2c69-4cee-414b-99ff-c843ceac8bb7" released by "_delete_snapshot" :: held 3.674s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-f3b47841-f3ba-46b3-9e1e-122a56051fe9" released by "delete_snapshot" :: held 3.716s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Created reservations ['1688ecbd-9148-4b88-99c6-4ccfa026f8a8', 'aa60bceb-a6fd-4975-ae96-be38f7e2121e', 'cc4f8326-37ae-4f29-9d9a-d9bab12d66e1', '04b4cb55-7cb0-45af-8564-830b787dfdd9'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:39 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:45:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-dad63dd7-08d2-459e-88c7-3f62d839df54 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-e58d2c69-4cee-414b-99ff-c843ceac8bb7-delete_snapshot" released by "delete_snapshot" :: held 3.876s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-f3b47841-f3ba-46b3-9e1e-122a56051fe9-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-f3b47841-f3ba-46b3-9e1e-122a56051fe9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-f3b47841-f3ba-46b3-9e1e-122a56051fe9" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:40 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-aed78b69-cd92-4efa-bac1-329be105ac81" returned: 0 in 0.719s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-f3b47841-f3ba-46b3-9e1e-122a56051fe9" acquired by "delete_volume" :: waited 0.034s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-quobyte-aed78b69-cd92-4efa-bac1-329be105ac81" released by "delete_volume" :: held 1.753s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[015de173-6f7d-45cb-b208-c1b7b6467d48]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Created reservations ['883039c3-0042-457f-a37c-dd870ecb8e93', '8f1f9db3-5889-45a1-8716-ead5c72c8966', '4aba642c-98b9-4524-ab8e-3125c4f3a4e5', 'd46f7bf8-e92b-4e01-80da-aeee7ea64bb7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:40 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 Jul 07 17:45:40 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:40 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:40 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Acquiring lock "cinder-e72fba5d-10df-4d9b-8f06-0918b606d1c8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Lock "cinder-e72fba5d-10df-4d9b-8f06-0918b606d1c8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Acquiring lock "cinder-quobyte-e72fba5d-10df-4d9b-8f06-0918b606d1c8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Lock "cinder-quobyte-e72fba5d-10df-4d9b-8f06-0918b606d1c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5165bd3e-4e05-427d-90b3-fb84abb73247]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:40 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 Jul 07 17:45:40 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:41 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9" returned: 0 in 1.079s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:41 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.915s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Deleted volume successfully. Jul 07 17:45:41 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9 Jul 07 17:45:41 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-161574d6-b03d-4c71-a910-1e6160da5e3b tempest-CreateVolumesFromSnapshotTest-1319897278 None] Lock "cinder-aed78b69-cd92-4efa-bac1-329be105ac81-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:41 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8" returned: 0 in 0.935s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:41 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8 Jul 07 17:45:41 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:42 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f3b47841-f3ba-46b3-9e1e-122a56051fe9" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-f3b47841-f3ba-46b3-9e1e-122a56051fe9" released by "delete_volume" :: held 1.928s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Created reservations ['14b84d07-99d3-4d92-8200-90eb3cf48009', '507c373f-0827-406f-a4ca-30e0987839f0', 'd7dfc9ca-1718-4d3e-9c2a-a400548b859f', '1c4f1deb-8c9f-4393-b9d1-165f40a8dd85'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:42 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:42 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:42 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-e72fba5d-10df-4d9b-8f06-0918b606d1c8" returned: 0 in 0.782s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Lock "cinder-quobyte-e72fba5d-10df-4d9b-8f06-0918b606d1c8" released by "delete_volume" :: held 1.789s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Created reservations ['4076704a-bf45-4431-b2f4-c8b266f00290', '8bd86753-682c-47ef-af98-70bb1975053b', '5670058d-803e-44f7-a1e3-83a4e949bec9', '3b23d622-1a36-4b26-b7ed-381dd9f4e673'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:42 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:42 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:42 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (113d58d7-8c4f-4033-9fb7-7aa8d654eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb9cfe7-dfcc-4e1b-bb7d-cf550158ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb9cfe7-dfcc-4e1b-bb7d-cf550158ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851395617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28580a16-1f9f-4fb9-9734-283f7c11f317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:43Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0328d212-99c1-4653-a4a4-3dcf968e6a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0328d212-99c1-4653-a4a4-3dcf968e6a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce08435-d075-4b9d-a7d2-fe10a7b03d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce08435-d075-4b9d-a7d2-fe10a7b03d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28580a16-1f9f-4fb9-9734-283f7c11f317', 'volume_name': 'volume-28580a16-1f9f-4fb9-9734-283f7c11f317', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a8f703-6b51-48ea-9637-9fc53bc746ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a8f703-6b51-48ea-9637-9fc53bc746ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0baeea-d9a0-4a65-b3ad-2b3b4496501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Volume 28580a16-1f9f-4fb9-9734-283f7c11f317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28580a16-1f9f-4fb9-9734-283f7c11f317', 'volume_size': 1} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851395617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28580a16-1f9f-4fb9-9734-283f7c11f317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:43Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Creating volume 28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:43 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:43 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 1073741824 Jul 07 17:45:43 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:43 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.970s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2fcdd645-bf9b-4db6-b4f5-8f735885a426 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-f3b47841-f3ba-46b3-9e1e-122a56051fe9-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Flow 'volume_create_manager' (4323af9c-445d-43fd-ae5a-fbb54162de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:43 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff43d908-b595-467c-8ab3-2a3532fa2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.947s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Deleted volume successfully. Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff43d908-b595-467c-8ab3-2a3532fa2639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057550539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced370955b97451a8d9af98d64c1a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:44Z,use_quota=True,user_id='2268b16b7d2348099cd17bfb2117d954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe5ba5c-8f41-4b1b-b7ce-142908408b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe5ba5c-8f41-4b1b-b7ce-142908408b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e5a1cc-1e99-4ca7-9ada-6d280ed77d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e5a1cc-1e99-4ca7-9ada-6d280ed77d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1', 'volume_name': 'volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc88cfe7-9b3f-4483-aa17-ec81513adb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc88cfe7-9b3f-4483-aa17-ec81513adb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92cdd57-1713-4a1d-a661-5382aec547e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:43 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Volume 6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1', 'volume_size': 1} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-67313987-e202-4f8d-beda-a7920aef5c59 tempest-ProjectReaderTests-719546489 None] Lock "cinder-e72fba5d-10df-4d9b-8f06-0918b606d1c8-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:44 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 1073741824" returned: 0 in 1.040s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:44 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 Jul 07 17:45:44 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Flow 'volume_create_manager' (e8f41761-bd7e-4390-ac1a-05d6ca5d51a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ada6d-6f6a-4b51-b3fc-2b834ecce820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ada6d-6f6a-4b51-b3fc-2b834ecce820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b07e6d-196f-41a0-bac3-58b388eec3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c7f9edf383498ca4b9e8739256b843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:44Z,use_quota=True,user_id='6b53af1085384a988e50d5355df225b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f20c652-0ecf-4390-99df-5623621727d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f20c652-0ecf-4390-99df-5623621727d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed771c3f-72b8-4455-9675-a13e1a239e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed771c3f-72b8-4455-9675-a13e1a239e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b07e6d-196f-41a0-bac3-58b388eec3d6', 'volume_name': 'volume-84b07e6d-196f-41a0-bac3-58b388eec3d6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e73240-bded-4361-aec6-886318f93649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e73240-bded-4361-aec6-886318f93649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d8e857-ca1b-4011-9de0-c863454d0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Volume 84b07e6d-196f-41a0-bac3-58b388eec3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b07e6d-196f-41a0-bac3-58b388eec3d6', 'volume_size': 1} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:44 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317" returned: 0 in 0.689s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057550539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced370955b97451a8d9af98d64c1a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:44Z,use_quota=True,user_id='2268b16b7d2348099cd17bfb2117d954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Creating volume 6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:44 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:44 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 1073741824 Jul 07 17:45:44 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0baeea-d9a0-4a65-b3ad-2b3b4496501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28580a16-1f9f-4fb9-9734-283f7c11f317', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a859d30e-2866-4e9c-ac21-03b668d8a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Volume volume-28580a16-1f9f-4fb9-9734-283f7c11f317 (28580a16-1f9f-4fb9-9734-283f7c11f317): created successfully Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a859d30e-2866-4e9c-ac21-03b668d8a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (113d58d7-8c4f-4033-9fb7-7aa8d654eed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:44 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-aee31201-24f5-4f1d-a9fa-53e70dc308c9 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:45:45 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 1073741824" returned: 0 in 0.906s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:45 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 Jul 07 17:45:45 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:46 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1" returned: 0 in 0.698s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b07e6d-196f-41a0-bac3-58b388eec3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c7f9edf383498ca4b9e8739256b843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:44Z,use_quota=True,user_id='6b53af1085384a988e50d5355df225b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Creating volume 84b07e6d-196f-41a0-bac3-58b388eec3d6 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:46 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:46 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 1073741824 Jul 07 17:45:46 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92cdd57-1713-4a1d-a661-5382aec547e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3f0b58-33bc-417b-b0b3-902a04665569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Volume volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 (6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1): created successfully Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3f0b58-33bc-417b-b0b3-902a04665569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Flow 'volume_create_manager' (4323af9c-445d-43fd-ae5a-fbb54162de2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-eb305e9e-e149-492d-a987-9ff7fe4716ef tempest-ProjectReaderTests-719546489 None] Created volume successfully. Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Acquiring lock "cinder-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Lock "cinder-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Acquiring lock "cinder-quobyte-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Lock "cinder-quobyte-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b287ba12-116d-4362-9c4b-27bf2e3b05d1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:47 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 Jul 07 17:45:47 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:47 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 1073741824" returned: 0 in 0.887s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:47 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=194,cinder:SELECT=148,cinder:INSERT=62,cinder:DELETE=21 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:47 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 Jul 07 17:45:47 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:47 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1" returned: 0 in 0.859s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:47 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1 Jul 07 17:45:47 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:48 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.811s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=145,cinder:UPDATE=205,cinder:DELETE=14,cinder:INSERT=44 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot b34b031b-40f6-4ddb-9607-27c89267d649 of volume 28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d8e857-ca1b-4011-9de0-c863454d0111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b07e6d-196f-41a0-bac3-58b388eec3d6', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f537f78-e59f-4238-b231-392ba62e2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ce078-6fb3-4eed-8be6-5b6d5d962906]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:48 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Volume volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 (84b07e6d-196f-41a0-bac3-58b388eec3d6): created successfully Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f537f78-e59f-4238-b231-392ba62e2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Flow 'volume_create_manager' (e8f41761-bd7e-4390-ac1a-05d6ca5d51a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:48 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2c0122e2-019a-4ce4-aee9-2c4ccdcc31cc tempest-CinderUnicodeTest-1397986083 None] Created volume successfully. Jul 07 17:45:48 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 Jul 07 17:45:48 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:48 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1" returned: 0 in 0.771s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Lock "cinder-quobyte-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1" released by "delete_volume" :: held 1.686s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Created reservations ['de21f9e3-2100-4ee5-9ec8-a9064c64f604', 'f71f47bd-df42-43b9-9e5a-dd96f1968d73', '07c91b11-5ee5-42e9-b830-b2f4200d0362', '81b6434d-e7c9-4b0c-b293-eb4a11cb242f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:48 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:48 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:49 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317" returned: 0 in 0.870s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:49 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 1G Jul 07 17:45:49 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Flow 'volume_create_manager' (5178e1df-f21c-42c6-9484-0d27d98bb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58455c56-08cd-42ed-bcd7-ee8ab21f3464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58455c56-08cd-42ed-bcd7-ee8ab21f3464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1002565825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c7f9edf383498ca4b9e8739256b843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:49Z,use_quota=True,user_id='6b53af1085384a988e50d5355df225b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae99549-eb99-413e-8f9a-73d6cddc23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae99549-eb99-413e-8f9a-73d6cddc23b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27165a4f-ed1e-4831-9600-2388da370d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27165a4f-ed1e-4831-9600-2388da370d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51', 'volume_name': 'volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16348fb2-979d-4324-97d9-1c275618abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16348fb2-979d-4324-97d9-1c275618abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fab1c08-0618-4bf8-a841-39942699286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Volume f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51', 'volume_size': 1} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:49 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.858s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:49 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Deleted volume successfully. Jul 07 17:45:49 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-2b57f693-1d0f-40e8-b72f-dcb1c9add249 tempest-ProjectReaderTests-719546489 None] Lock "cinder-6b39d7b8-dbc3-4d06-a04e-6f4a7284e1b1-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:50 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 1G" returned: 0 in 1.128s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28580a16-1f9f-4fb9-9734-283f7c11f317 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:50 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28580a16-1f9f-4fb9-9734-283f7c11f317 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 Jul 07 17:45:50 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:51 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28580a16-1f9f-4fb9-9734-283f7c11f317 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649" returned: 0 in 0.843s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:51 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 is being set with open permissions: ugo+rw Jul 07 17:45:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:51 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 Jul 07 17:45:51 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:51 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649" returned: 0 in 0.653s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:51 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info Jul 07 17:45:51 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:52 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info" returned: 0 in 0.667s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:52 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info is being set with open permissions: ugo+rw Jul 07 17:45:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:52 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info Jul 07 17:45:52 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:53 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.info" returned: 0 in 0.630s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.899s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.468s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1002565825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c7f9edf383498ca4b9e8739256b843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:49Z,use_quota=True,user_id='6b53af1085384a988e50d5355df225b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Creating volume f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:53 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:53 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 1073741824 Jul 07 17:45:53 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:53 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-abc88ed8-4c69-4919-b890-c34811031376 tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-b34b031b-40f6-4ddb-9607-27c89267d649-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-b34b031b-40f6-4ddb-9607-27c89267d649-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-28580a16-1f9f-4fb9-9734-283f7c11f317" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-28580a16-1f9f-4fb9-9734-283f7c11f317" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-b34b031b-40f6-4ddb-9607-27c89267d649" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-b34b031b-40f6-4ddb-9607-27c89267d649" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot b34b031b-40f6-4ddb-9607-27c89267d649 of volume 28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc2ed6-c8ea-489a-9077-f198d690926c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:53 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 Jul 07 17:45:53 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:54 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 1073741824" returned: 0 in 0.942s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:54 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 Jul 07 17:45:54 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:54 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649" returned: 0 in 0.819s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28580a16-1f9f-4fb9-9734-283f7c11f317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f684d8-6604-4e32-afaa-32d4307506d8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:54 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" returned: 0 in 0.680s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:54 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 Jul 07 17:45:54 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fab1c08-0618-4bf8-a841-39942699286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef945e3-3b47-4019-8a15-88d3bddb76f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:54 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Volume volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 (f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51): created successfully Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef945e3-3b47-4019-8a15-88d3bddb76f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:54 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Flow 'volume_create_manager' (5178e1df-f21c-42c6-9484-0d27d98bb263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:54 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-78c2d1e3-c7e0-40d1-9e24-0a7cdcc450c3 tempest-CinderUnicodeTest-1397986083 None] Created volume successfully. Jul 07 17:45:55 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317" returned: 0 in 0.789s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:55 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 Jul 07 17:45:55 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Creating offline snapshot 81e4820f-0455-4f0d-9ad9-2997d720db66 of volume f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a79df8-0b52-447b-85f0-4c6a540a2b8d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:56 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 Jul 07 17:45:56 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:56 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649" returned: 0 in 0.803s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:56 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649 Jul 07 17:45:56 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:56 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" returned: 0 in 0.823s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:56 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317.b34b031b-40f6-4ddb-9607-27c89267d649" returned: 0 in 0.686s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:56 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 1G Jul 07 17:45:56 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-b34b031b-40f6-4ddb-9607-27c89267d649" released by "_delete_snapshot" :: held 3.208s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-28580a16-1f9f-4fb9-9734-283f7c11f317" released by "delete_snapshot" :: held 3.235s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:57 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Created reservations ['9c84168d-46eb-4bc8-8cb8-01d656df3353', '6fbb4e65-e04f-4375-a537-a0c81e9dec57', 'a3033864-07fd-4bbb-8917-992a268a5e19', '70e2933c-50d2-4626-b888-c9a45813e976'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:57 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:45:57 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-bd3f5fe6-914b-4716-b7f9-1222332ac043 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-b34b031b-40f6-4ddb-9607-27c89267d649-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:57 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 1G" returned: 0 in 0.832s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:57 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 Jul 07 17:45:57 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-28580a16-1f9f-4fb9-9734-283f7c11f317-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-28580a16-1f9f-4fb9-9734-283f7c11f317-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-28580a16-1f9f-4fb9-9734-283f7c11f317" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-28580a16-1f9f-4fb9-9734-283f7c11f317" acquired by "delete_volume" :: waited 0.032s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c3ca5-d661-4c35-9864-e591a5ae1eae]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:58 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 Jul 07 17:45:58 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:58 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66" returned: 0 in 0.704s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:58 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 is being set with open permissions: ugo+rw Jul 07 17:45:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:58 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 Jul 07 17:45:58 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:59 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317" returned: 0 in 0.874s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:59 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317 Jul 07 17:45:59 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:59 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66" returned: 0 in 0.681s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:59 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info Jul 07 17:45:59 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:59 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-28580a16-1f9f-4fb9-9734-283f7c11f317" returned: 0 in 0.699s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-28580a16-1f9f-4fb9-9734-283f7c11f317" released by "delete_volume" :: held 1.640s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Created reservations ['a9766ec9-8450-4010-9ce1-d62b1c1c203e', 'd455610c-7303-4702-9054-3430dbe3bde0', 'b29cfe04-9342-4b6a-9ba0-96f31f6aa0a4', '41e8b9d4-31e2-42b8-8977-381c1534fca7'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:59 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:45:59 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:59 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:59 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info is being set with open permissions: ugo+rw Jul 07 17:45:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:59 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info Jul 07 17:45:59 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:00 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.702s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5e2fdf63-29e9-4a46-9478-66abac047e9c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-28580a16-1f9f-4fb9-9734-283f7c11f317-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:00 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.info" returned: 0 in 0.711s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.600s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:00 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fc7709e6-409b-4ebd-88b8-279376238dc9 tempest-CinderUnicodeTest-1397986083 None] Create snapshot completed successfully Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (cb556131-1d4d-4d01-9875-2dd9ea02d252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ded3c-7cee-47fa-b6b8-dc62cd8b8b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ded3c-7cee-47fa-b6b8-dc62cd8b8b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575146106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b5aa18-5c26-4e21-8e8f-be2198ee65e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:01Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed536fbc-eced-4f8c-9084-871c0956d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed536fbc-eced-4f8c-9084-871c0956d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2027e55-70a4-4762-82cb-808baceb2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2027e55-70a4-4762-82cb-808baceb2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b5aa18-5c26-4e21-8e8f-be2198ee65e8', 'volume_name': 'volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6468613-8604-4cfa-a15e-05a3c19ef2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6468613-8604-4cfa-a15e-05a3c19ef2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d85180c-1a40-450e-b33c-0084af9f9526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:00 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Volume 55b5aa18-5c26-4e21-8e8f-be2198ee65e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8', 'volume_size': 1} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575146106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b5aa18-5c26-4e21-8e8f-be2198ee65e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:01Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Creating volume 55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:46:00 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:46:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:00 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 1073741824 Jul 07 17:46:00 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-81e4820f-0455-4f0d-9ad9-2997d720db66-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-81e4820f-0455-4f0d-9ad9-2997d720db66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-quobyte-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-quobyte-81e4820f-0455-4f0d-9ad9-2997d720db66" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-81e4820f-0455-4f0d-9ad9-2997d720db66" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Deleting offline snapshot 81e4820f-0455-4f0d-9ad9-2997d720db66 of volume f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] snapshot_file for this snap is: volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79224aa-017e-46e4-b9f4-e8c2281fb2c2]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:01 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 Jul 07 17:46:01 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:01 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 1073741824" returned: 0 in 0.843s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:01 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 Jul 07 17:46:01 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:02 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66" returned: 0 in 0.818s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[21961956-3991-4d43-b34f-5389832eead5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:02 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 Jul 07 17:46:02 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:02 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" returned: 0 in 0.667s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d85180c-1a40-450e-b33c-0084af9f9526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f16a8e-0dce-4d67-94d5-400d1081310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:02 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Volume volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 (55b5aa18-5c26-4e21-8e8f-be2198ee65e8): created successfully Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f16a8e-0dce-4d67-94d5-400d1081310b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:02 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (cb556131-1d4d-4d01-9875-2dd9ea02d252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:02 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f2ab5851-8810-4a35-9ccf-cd937c848dd6 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot 8398c0c5-5e1c-47a3-ba9b-09d1666606cf of volume 55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b11115-b155-4e08-86a8-145729e7db17]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:03 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" returned: 0 in 0.838s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:03 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 Jul 07 17:46:03 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:03 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 Jul 07 17:46:03 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:03 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" returned: 0 in 0.783s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:03 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66" returned: 0 in 0.755s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:03 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf 1G Jul 07 17:46:03 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:03 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66 Jul 07 17:46:03 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:04 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51.81e4820f-0455-4f0d-9ad9-2997d720db66" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-81e4820f-0455-4f0d-9ad9-2997d720db66" released by "_delete_snapshot" :: held 3.184s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" released by "delete_snapshot" :: held 3.211s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Created reservations ['5db87c0e-1274-46a0-b690-27ad7ce9619b', '685b9cab-c8d1-4b48-8575-a85ebcecf416', '6a84a4c3-e634-4a6c-90d6-92c65bc84756', '152c5140-feb6-402f-bcb6-ed9c6ac30076'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:04 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf 1G" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:04 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Delete snapshot completed successfully. Jul 07 17:46:04 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf Jul 07 17:46:04 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c8b6e595-9c71-4723-89bd-f0681f88c5ac tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-81e4820f-0455-4f0d-9ad9-2997d720db66-delete_snapshot" released by "delete_snapshot" :: held 3.361s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:05 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf" returned: 0 in 0.666s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:05 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf is being set with open permissions: ugo+rw Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:05 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf Jul 07 17:46:05 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-quobyte-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f74c02-317d-4733-822e-5e636ff8a262]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:05 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 Jul 07 17:46:05 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:06 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf" returned: 0 in 0.664s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:06 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info Jul 07 17:46:06 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:06 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:06 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51 Jul 07 17:46:06 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:06 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info" returned: 0 in 0.659s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:06 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info is being set with open permissions: ugo+rw Jul 07 17:46:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:06 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info Jul 07 17:46:06 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:07 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" returned: 0 in 0.624s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51" released by "delete_volume" :: held 1.457s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Created reservations ['ce275fa9-31a2-4789-86c9-89fbe8cf4f74', '690c49ed-4a40-44ba-bbbc-68a72ff57607', 'f6199b6f-b0f3-427c-9dd9-b56c78856131', 'a786a329-7546-471f-9cb4-359e5297e5a4'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:07 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:46:07 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:07 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.info" returned: 0 in 0.668s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.340s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-6d7f562b-7976-44d9-b977-c137097eac1b tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-84b07e6d-196f-41a0-bac3-58b388eec3d6-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-84b07e6d-196f-41a0-bac3-58b388eec3d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "cinder-quobyte-84b07e6d-196f-41a0-bac3-58b388eec3d6" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:07 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.648s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-84b07e6d-196f-41a0-bac3-58b388eec3d6" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Deleted volume successfully. Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c497e-e0f3-4f55-b3a1-1475414d2369]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5500fdad-a479-4284-a025-516ce8497faa tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-f166d8fb-5022-40f1-9ad1-a0ac2dcd9f51-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:08 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 Jul 07 17:46:08 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-8398c0c5-5e1c-47a3-ba9b-09d1666606cf-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-8398c0c5-5e1c-47a3-ba9b-09d1666606cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-8398c0c5-5e1c-47a3-ba9b-09d1666606cf" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-8398c0c5-5e1c-47a3-ba9b-09d1666606cf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot 8398c0c5-5e1c-47a3-ba9b-09d1666606cf of volume 55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c74126-3817-4b72-b861-2967f92247fe]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:08 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf Jul 07 17:46:08 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:08 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:08 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6 Jul 07 17:46:08 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:09 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf" returned: 0 in 0.763s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[71067a72-0401-4001-9705-8d90a7e7fc78]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:09 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 Jul 07 17:46:09 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:09 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-84b07e6d-196f-41a0-bac3-58b388eec3d6" returned: 0 in 0.652s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-quobyte-84b07e6d-196f-41a0-bac3-58b388eec3d6" released by "delete_volume" :: held 1.505s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Created reservations ['cab3186a-5624-458d-a9bf-009bf1dd9685', '5f00abd1-ed5f-4475-a2be-8df379adffca', '70dff851-e2a1-4609-a137-b1ef9e737e16', '70f2b862-62c3-460d-837c-01aa1ad4c557'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:09 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:46:09 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:09 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" returned: 0 in 0.761s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:09 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf Jul 07 17:46:09 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:10 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.697s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:10 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Deleted volume successfully. Jul 07 17:46:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-190eac9f-73e3-4f51-a8f6-874240875c98 tempest-CinderUnicodeTest-1397986083 None] Lock "cinder-84b07e6d-196f-41a0-bac3-58b388eec3d6-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:10 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf" returned: 0 in 0.807s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:10 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf Jul 07 17:46:10 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:11 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8.8398c0c5-5e1c-47a3-ba9b-09d1666606cf" returned: 0 in 0.741s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-8398c0c5-5e1c-47a3-ba9b-09d1666606cf" released by "_delete_snapshot" :: held 3.166s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" released by "delete_snapshot" :: held 3.186s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:11 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Created reservations ['4f84ed14-1e48-43b3-873a-4d9d4a48856a', '51a35e66-8945-4199-8a41-1b3ad3d2a8a4', '439e2aee-02ad-4dd2-9d12-3a579b5262a5', '19fd93e4-b43f-4931-84f6-1024ef6b6eba'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:11 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:46:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-514741db-b35f-4fa1-a254-ea52e207e9e4 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-8398c0c5-5e1c-47a3-ba9b-09d1666606cf-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-55b5aa18-5c26-4e21-8e8f-be2198ee65e8-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Lock "cinder-55b5aa18-5c26-4e21-8e8f-be2198ee65e8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68bfb0-281b-4c30-8e34-bcaa60c40ad3]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:12 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 Jul 07 17:46:12 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:13 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" returned: 0 in 0.822s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:13 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8 Jul 07 17:46:13 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:14 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" returned: 0 in 0.635s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-55b5aa18-5c26-4e21-8e8f-be2198ee65e8" released by "delete_volume" :: held 1.524s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Created reservations ['5fc80b91-43c0-4913-9eac-7e69bb39929d', 'f2ce1dc5-2ed6-4825-9c0f-00acac8b2dd9', 'e8293684-6dd4-4df7-b23c-341a130c18de', '1bfe84c8-6b9b-4a2f-8dcc-9c0cecfcb0ca'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:14 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:46:14 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:15 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.716s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:15 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f3362359-fa39-4acf-8997-44d2755661cc tempest-ProjectMemberTests-1518515255 None] Lock "cinder-55b5aa18-5c26-4e21-8e8f-be2198ee65e8-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (03da01e2-bcc7-4d55-998d-3730d6a1449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2660b0-338c-4e46-9acf-e2a944cd4957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2660b0-338c-4e46-9acf-e2a944cd4957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011450705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809f1a9b-0671-4777-a77f-330ea4cffc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:15Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d38e80-686c-4e73-aa48-b7dcdbdf8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d38e80-686c-4e73-aa48-b7dcdbdf8f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7205fbb-fd74-4f24-84e5-163d88940631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7205fbb-fd74-4f24-84e5-163d88940631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809f1a9b-0671-4777-a77f-330ea4cffc8d', 'volume_name': 'volume-809f1a9b-0671-4777-a77f-330ea4cffc8d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2933c01-cde2-4d7a-9314-c75c3c2eb665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2933c01-cde2-4d7a-9314-c75c3c2eb665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e5d75d-879d-4dd4-9ff5-bf425953824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:15 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Volume 809f1a9b-0671-4777-a77f-330ea4cffc8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809f1a9b-0671-4777-a77f-330ea4cffc8d', 'volume_size': 1} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011450705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809f1a9b-0671-4777-a77f-330ea4cffc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:15Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Creating volume 809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:46:15 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:46:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:15 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d 1073741824 Jul 07 17:46:15 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:16 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d 1073741824" returned: 0 in 0.898s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:16 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d Jul 07 17:46:16 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:17 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d" returned: 0 in 0.610s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e5d75d-879d-4dd4-9ff5-bf425953824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809f1a9b-0671-4777-a77f-330ea4cffc8d', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18d61d4-cc2f-4adc-b086-d817929eee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Volume volume-809f1a9b-0671-4777-a77f-330ea4cffc8d (809f1a9b-0671-4777-a77f-330ea4cffc8d): created successfully Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18d61d4-cc2f-4adc-b086-d817929eee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (03da01e2-bcc7-4d55-998d-3730d6a1449f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ed08b554-02ae-43ce-a66f-e0cb84039422 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot c779f448-53a7-4fd4-9174-0c532727c2bf of volume 809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7701878-719a-46d8-b8d4-e3ed6a31c350]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:17 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d Jul 07 17:46:17 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:18 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d" returned: 0 in 0.804s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:18 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf 1G Jul 07 17:46:18 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:19 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf 1G" returned: 0 in 0.785s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-809f1a9b-0671-4777-a77f-330ea4cffc8d -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:19 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-809f1a9b-0671-4777-a77f-330ea4cffc8d -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf Jul 07 17:46:19 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:19 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-809f1a9b-0671-4777-a77f-330ea4cffc8d -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf" returned: 0 in 0.676s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:19 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf is being set with open permissions: ugo+rw Jul 07 17:46:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:19 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf Jul 07 17:46:19 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:20 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf" returned: 0 in 0.670s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:20 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info Jul 07 17:46:20 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:21 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info" returned: 0 in 0.627s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:21 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info is being set with open permissions: ugo+rw Jul 07 17:46:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:21 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info Jul 07 17:46:21 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:21 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.info" returned: 0 in 0.629s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.276s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-370068c3-fd32-427e-be0c-6b659cf8d930 tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-c779f448-53a7-4fd4-9174-0c532727c2bf-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-c779f448-53a7-4fd4-9174-0c532727c2bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-809f1a9b-0671-4777-a77f-330ea4cffc8d" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-809f1a9b-0671-4777-a77f-330ea4cffc8d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-c779f448-53a7-4fd4-9174-0c532727c2bf" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-c779f448-53a7-4fd4-9174-0c532727c2bf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot c779f448-53a7-4fd4-9174-0c532727c2bf of volume 809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc428a-cbc2-4936-87d2-198ccc89af22]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:22 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf Jul 07 17:46:22 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:23 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf" returned: 0 in 0.740s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-809f1a9b-0671-4777-a77f-330ea4cffc8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:46:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a33a69-38e3-4dcb-8939-8482af456360]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:23 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d Jul 07 17:46:23 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:24 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d" returned: 0 in 0.733s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:24 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf Jul 07 17:46:24 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:25 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf" returned: 0 in 0.692s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:25 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf Jul 07 17:46:25 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:25 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d.c779f448-53a7-4fd4-9174-0c532727c2bf" returned: 0 in 0.655s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-c779f448-53a7-4fd4-9174-0c532727c2bf" released by "_delete_snapshot" :: held 2.908s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-809f1a9b-0671-4777-a77f-330ea4cffc8d" released by "delete_snapshot" :: held 2.932s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Created reservations ['efcfcdcc-a1c8-4732-8307-ba72c5c84bb7', '30842506-8e3e-4b2a-9161-35802a6280d7', '8d04abe2-b7a4-4db8-b4d6-14b220322107', 'b758698a-7d6c-443d-bf4f-016dca045f3c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:25 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-e25dbb86-e14e-45f8-8741-1b28afc31304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-c779f448-53a7-4fd4-9174-0c532727c2bf-delete_snapshot" released by "delete_snapshot" :: held 3.063s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-809f1a9b-0671-4777-a77f-330ea4cffc8d-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Lock "cinder-809f1a9b-0671-4777-a77f-330ea4cffc8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-809f1a9b-0671-4777-a77f-330ea4cffc8d" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-809f1a9b-0671-4777-a77f-330ea4cffc8d" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12f1eb5-9b3f-47cd-98bf-76dc467b6996]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:26 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d Jul 07 17:46:26 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:26 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d" returned: 0 in 0.747s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:26 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d Jul 07 17:46:26 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:27 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-809f1a9b-0671-4777-a77f-330ea4cffc8d" returned: 0 in 0.655s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-809f1a9b-0671-4777-a77f-330ea4cffc8d" released by "delete_volume" :: held 1.459s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Created reservations ['c36ab647-e3e3-4749-a154-a2c36e46a46a', '98e8eb12-8170-437c-8571-5587a86fb6b7', '7b3d57f8-562f-4f95-a07d-c6f45c3d6909', '49be1db9-5ce5-4a66-bb95-3e039c70c12f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:27 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:46:27 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:28 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.683s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f79a9f93-54c5-4232-a6a5-bddd66ef237f tempest-ProjectMemberTests-1518515255 None] Lock "cinder-809f1a9b-0671-4777-a77f-330ea4cffc8d-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (5bae74e7-9686-403c-ba7a-12a1bdbb1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5f1808-135f-4fcb-8031-d60c9cdfacbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5f1808-135f-4fcb-8031-d60c9cdfacbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017892010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ac5846-b462-4996-a216-ace6f20777e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:29Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82c31db-167f-421c-858f-6fbdba397021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82c31db-167f-421c-858f-6fbdba397021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d483cc6d-b1ee-491f-bc87-78d83229dbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d483cc6d-b1ee-491f-bc87-78d83229dbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ac5846-b462-4996-a216-ace6f20777e1', 'volume_name': 'volume-a4ac5846-b462-4996-a216-ace6f20777e1', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64c2567-2ccd-4e40-ae0c-4a70cac15f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64c2567-2ccd-4e40-ae0c-4a70cac15f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1999fe-416c-4901-81f8-d10c84ba1be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:28 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Volume a4ac5846-b462-4996-a216-ace6f20777e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ac5846-b462-4996-a216-ace6f20777e1', 'volume_size': 1} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017892010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ac5846-b462-4996-a216-ace6f20777e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:29Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Creating volume a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:46:28 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:46:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:28 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 1073741824 Jul 07 17:46:28 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:29 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 1073741824" returned: 0 in 0.813s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:29 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 Jul 07 17:46:29 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:30 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1" returned: 0 in 0.615s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1999fe-416c-4901-81f8-d10c84ba1be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ac5846-b462-4996-a216-ace6f20777e1', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc4ea57-87c9-4068-a740-e041610f9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Volume volume-a4ac5846-b462-4996-a216-ace6f20777e1 (a4ac5846-b462-4996-a216-ace6f20777e1): created successfully Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc4ea57-87c9-4068-a740-e041610f9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (5bae74e7-9686-403c-ba7a-12a1bdbb1841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:30 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-cf71eb60-d8dc-44e6-bede-8bc0f8980680 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot cf674c68-d620-455d-83b8-d6c177fb88a8 of volume a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b1b86c-a10b-47f9-a193-d87046d78f83]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:31 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 Jul 07 17:46:31 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:31 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1" returned: 0 in 0.777s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:31 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 1G Jul 07 17:46:31 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:32 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 1G" returned: 0 in 0.808s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ac5846-b462-4996-a216-ace6f20777e1 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:32 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ac5846-b462-4996-a216-ace6f20777e1 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 Jul 07 17:46:32 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:46:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:46:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:46:33 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ac5846-b462-4996-a216-ace6f20777e1 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8" returned: 0 in 0.697s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:33 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 is being set with open permissions: ugo+rw Jul 07 17:46:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:33 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 Jul 07 17:46:33 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:33 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8" returned: 0 in 0.656s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:34 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info Jul 07 17:46:34 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:34 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info" returned: 0 in 0.636s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:34 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info is being set with open permissions: ugo+rw Jul 07 17:46:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:34 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info Jul 07 17:46:34 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:35 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.info" returned: 0 in 0.660s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:35 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-33de3b93-e932-447f-8cdf-623b243fc677 tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-cf674c68-d620-455d-83b8-d6c177fb88a8-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-cf674c68-d620-455d-83b8-d6c177fb88a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-a4ac5846-b462-4996-a216-ace6f20777e1" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a4ac5846-b462-4996-a216-ace6f20777e1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-cf674c68-d620-455d-83b8-d6c177fb88a8" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-cf674c68-d620-455d-83b8-d6c177fb88a8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot cf674c68-d620-455d-83b8-d6c177fb88a8 of volume a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcf3d3e-8b56-4541-83b8-69e43ce5581e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:36 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 Jul 07 17:46:36 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:37 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:37 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ac5846-b462-4996-a216-ace6f20777e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:46:37 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c084a9d-ad1e-4855-a3bf-a5b60f5038b7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:37 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 Jul 07 17:46:37 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:37 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1" returned: 0 in 0.758s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:37 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 Jul 07 17:46:37 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:38 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8" returned: 0 in 0.700s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:38 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8 Jul 07 17:46:38 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:39 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1.cf674c68-d620-455d-83b8-d6c177fb88a8" returned: 0 in 0.658s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-cf674c68-d620-455d-83b8-d6c177fb88a8" released by "_delete_snapshot" :: held 3.003s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:39 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a4ac5846-b462-4996-a216-ace6f20777e1" released by "delete_snapshot" :: held 3.031s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:41 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Created reservations ['57a74d85-363a-4025-8101-00ddaee509b6', 'd668969b-90d5-465c-81fa-d7d685908c13', '331da17a-f24e-46cb-b433-f75d0c393a04', 'eb765a2d-5632-445a-9368-1f8bb480fd20'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:42 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-282619ff-7d1f-43f8-b489-94403ccd3324 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-cf674c68-d620-455d-83b8-d6c177fb88a8-delete_snapshot" released by "delete_snapshot" :: held 5.971s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-a4ac5846-b462-4996-a216-ace6f20777e1-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-a4ac5846-b462-4996-a216-ace6f20777e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-a4ac5846-b462-4996-a216-ace6f20777e1" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a4ac5846-b462-4996-a216-ace6f20777e1" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[751fe9c7-8518-47df-9da0-4da34a04a765]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:42 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 Jul 07 17:46:42 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:43 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1" returned: 0 in 0.752s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:43 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1 Jul 07 17:46:43 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:43 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a4ac5846-b462-4996-a216-ace6f20777e1" returned: 0 in 0.691s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-a4ac5846-b462-4996-a216-ace6f20777e1" released by "delete_volume" :: held 1.502s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Created reservations ['0e03a550-32fd-4a1f-852b-978844b265d0', '8054351f-dfe7-4014-8b6d-01298c027e21', '2553a2b3-2f2a-4f10-8371-3816050d1d5c', '4f0a92c0-9d4c-44b4-8030-0112d1de6937'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:44 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:46:44 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:44 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.691s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:44 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:46:44 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f317f3ca-747e-41e5-b166-38b6a11b910c tempest-ProjectMemberTests-1518515255 None] Lock "cinder-a4ac5846-b462-4996-a216-ace6f20777e1-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (4e37b193-db06-48ca-97af-284cd523e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18121ad-e33a-422d-babc-a79fa25ca71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18121ad-e33a-422d-babc-a79fa25ca71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030275703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847624b1-44fa-46a9-93cc-ba9dfa11d140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:45Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419fbfaa-d23e-4b77-9b33-a889bae6185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419fbfaa-d23e-4b77-9b33-a889bae6185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc70da39-3241-4619-aeda-2fc1bc02bf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc70da39-3241-4619-aeda-2fc1bc02bf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847624b1-44fa-46a9-93cc-ba9dfa11d140', 'volume_name': 'volume-847624b1-44fa-46a9-93cc-ba9dfa11d140', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5410325-ce37-4aef-8714-43bb577b770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5410325-ce37-4aef-8714-43bb577b770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930d347a-27ef-44a8-856f-a70fee252a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Volume 847624b1-44fa-46a9-93cc-ba9dfa11d140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847624b1-44fa-46a9-93cc-ba9dfa11d140', 'volume_size': 1} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030275703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847624b1-44fa-46a9-93cc-ba9dfa11d140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:46:45Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Creating volume 847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:46:45 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:46:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:45 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 1073741824 Jul 07 17:46:45 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:46 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 1073741824" returned: 0 in 0.857s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:46 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 Jul 07 17:46:46 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:46 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140" returned: 0 in 0.700s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930d347a-27ef-44a8-856f-a70fee252a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847624b1-44fa-46a9-93cc-ba9dfa11d140', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a2ec9a-76e7-470b-be4f-7e77dbe8a3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:46 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Volume volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 (847624b1-44fa-46a9-93cc-ba9dfa11d140): created successfully Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a2ec9a-76e7-470b-be4f-7e77dbe8a3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:46 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (4e37b193-db06-48ca-97af-284cd523e03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:46 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fa2eee66-ccb9-4fc3-bf16-a5e1c8659814 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:46:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:47 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot 372b7496-0409-4ec7-a4fa-73aece784c31 of volume 847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:46:47 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa36f614-42ed-4527-a48f-8f1709437eb0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:47 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 Jul 07 17:46:47 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:48 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140" returned: 0 in 0.757s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:48 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 1G Jul 07 17:46:48 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:48 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 1G" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:49 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 Jul 07 17:46:49 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:49 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31" returned: 0 in 0.685s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:49 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 is being set with open permissions: ugo+rw Jul 07 17:46:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:49 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 Jul 07 17:46:49 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:50 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31" returned: 0 in 0.618s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:50 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=79,cinder:UPDATE=107,cinder:DELETE=10,cinder:INSERT=24 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:46:50 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=86,cinder:INSERT=34,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:46:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:50 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info Jul 07 17:46:50 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:50 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info" returned: 0 in 0.646s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:50 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info is being set with open permissions: ugo+rw Jul 07 17:46:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:50 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info Jul 07 17:46:50 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:51 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.info" returned: 0 in 0.636s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.217s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:51 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-931c51b7-764a-4434-98f3-7f4d3d3001ff tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-372b7496-0409-4ec7-a4fa-73aece784c31-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Lock "cinder-372b7496-0409-4ec7-a4fa-73aece784c31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-847624b1-44fa-46a9-93cc-ba9dfa11d140" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-847624b1-44fa-46a9-93cc-ba9dfa11d140" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-372b7496-0409-4ec7-a4fa-73aece784c31" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-372b7496-0409-4ec7-a4fa-73aece784c31" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot 372b7496-0409-4ec7-a4fa-73aece784c31 of volume 847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62e3d5-2644-4b27-b328-1741636e67d8]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:52 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 Jul 07 17:46:52 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:53 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31" returned: 0 in 0.769s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:53 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-847624b1-44fa-46a9-93cc-ba9dfa11d140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:46:53 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3238e3a-5578-46f7-8ef7-93d8ea539fcd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:53 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 Jul 07 17:46:53 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:54 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:54 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 Jul 07 17:46:54 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:54 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31" returned: 0 in 0.722s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:54 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31 Jul 07 17:46:54 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:55 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140.372b7496-0409-4ec7-a4fa-73aece784c31" returned: 0 in 0.739s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-372b7496-0409-4ec7-a4fa-73aece784c31" released by "_delete_snapshot" :: held 3.045s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-847624b1-44fa-46a9-93cc-ba9dfa11d140" released by "delete_snapshot" :: held 3.066s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:55 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Created reservations ['86ccb482-b9df-4099-8683-0b45b46936e2', 'd404910d-dbf5-4016-91c0-e47ca64c9b22', '7b5a4a05-fbbf-4a1e-938c-df39d6fc6b17', 'f6df744a-0cbb-44be-b24c-2ad135c5e10c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:55 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:46:55 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-fb6d99ed-8053-403c-b050-0c6400736abb tempest-ProjectMemberTests-1518515255 None] Lock "cinder-372b7496-0409-4ec7-a4fa-73aece784c31-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-847624b1-44fa-46a9-93cc-ba9dfa11d140-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-847624b1-44fa-46a9-93cc-ba9dfa11d140-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-847624b1-44fa-46a9-93cc-ba9dfa11d140" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:46:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-847624b1-44fa-46a9-93cc-ba9dfa11d140" acquired by "delete_volume" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:46:56 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9db4c42-8e82-428b-94be-9e4d249e32a0]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:46:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:57 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 Jul 07 17:46:57 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:57 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140" returned: 0 in 0.767s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:57 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140 Jul 07 17:46:57 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:58 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-847624b1-44fa-46a9-93cc-ba9dfa11d140" returned: 0 in 0.636s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-847624b1-44fa-46a9-93cc-ba9dfa11d140" released by "delete_volume" :: held 1.467s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Created reservations ['48e30ad4-a472-4bbe-bf32-4585814784de', '20b9db6c-cc74-4eed-b945-004c102997d0', '0d906b82-cb94-44cb-9221-9404d2ccd053', '67a9ed6c-ada7-408e-994a-19ddb02b9535'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:58 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:46:58 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:59 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.631s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:59 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-248057c5-0aab-415d-aa62-d76d3a8c4e39 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-847624b1-44fa-46a9-93cc-ba9dfa11d140-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (958afd85-5c55-4332-ac33-41f240d5fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d2773a-91f6-4902-b26b-c05097676906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d2773a-91f6-4902-b26b-c05097676906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-382800081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe0ff5c-65ad-4a6a-b989-d8c389924c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:00Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3c35da-139e-42a0-9458-b42cd61b1a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3c35da-139e-42a0-9458-b42cd61b1a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a5023-378a-4589-ba7b-9e496c23b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a5023-378a-4589-ba7b-9e496c23b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe0ff5c-65ad-4a6a-b989-d8c389924c49', 'volume_name': 'volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f259b9-9b1b-463b-a6f2-adc6fa391d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f259b9-9b1b-463b-a6f2-adc6fa391d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546efbe2-e6a3-4464-bfff-75e0e27e1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:46:59 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Volume 4fe0ff5c-65ad-4a6a-b989-d8c389924c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49', 'volume_size': 1} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-382800081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe0ff5c-65ad-4a6a-b989-d8c389924c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ea4d73d1ad4665b4e45db7e6d050af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:00Z,use_quota=True,user_id='b57ad5df28c3404381b2360b4124c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Creating volume 4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:46:59 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:46:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:59 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 1073741824 Jul 07 17:46:59 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:00 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 1073741824" returned: 0 in 0.805s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:00 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 Jul 07 17:47:00 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:01 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" returned: 0 in 0.671s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546efbe2-e6a3-4464-bfff-75e0e27e1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374dcbb6-eeba-4f58-b380-0880a58ce209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:01 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Volume volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 (4fe0ff5c-65ad-4a6a-b989-d8c389924c49): created successfully Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374dcbb6-eeba-4f58-b380-0880a58ce209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Flow 'volume_create_manager' (958afd85-5c55-4332-ac33-41f240d5fc78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:01 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-9f11fee9-a9f5-4d86-8db6-7c4f361e86f8 tempest-ProjectMemberTests-1518515255 None] Created volume successfully. Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Creating offline snapshot be691029-a42b-4115-a0a6-9f28be032a82 of volume 4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b621e1e3-8dbf-42ac-ac51-6fc007637f28]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:01 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 Jul 07 17:47:01 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:02 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" returned: 0 in 0.734s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:02 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 1G Jul 07 17:47:02 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:03 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 1G" returned: 0 in 0.820s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:03 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 Jul 07 17:47:03 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:04 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82" returned: 0 in 0.638s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:04 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 is being set with open permissions: ugo+rw Jul 07 17:47:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:04 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 Jul 07 17:47:04 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:04 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82" returned: 0 in 0.601s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:04 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info Jul 07 17:47:04 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:05 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info" returned: 0 in 0.621s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:05 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info is being set with open permissions: ugo+rw Jul 07 17:47:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:05 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info Jul 07 17:47:05 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:05 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.info" returned: 0 in 0.617s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d7971e9b-3565-41ac-935b-265b25ff3986 tempest-ProjectMemberTests-1518515255 None] Create snapshot completed successfully Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-be691029-a42b-4115-a0a6-9f28be032a82-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-be691029-a42b-4115-a0a6-9f28be032a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-be691029-a42b-4115-a0a6-9f28be032a82" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-be691029-a42b-4115-a0a6-9f28be032a82" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Deleting offline snapshot be691029-a42b-4115-a0a6-9f28be032a82 of volume 4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] snapshot_file for this snap is: volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[5576f061-1ef7-4aa4-b2e7-d85333f86793]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:07 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 Jul 07 17:47:07 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:07 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82" returned: 0 in 0.716s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[3952c05f-d34f-435f-9cf7-9e5088b92e23]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:08 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 Jul 07 17:47:08 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:08 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" returned: 0 in 0.749s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:08 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 Jul 07 17:47:08 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:09 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82" returned: 0 in 0.715s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:09 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82 Jul 07 17:47:09 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:10 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49.be691029-a42b-4115-a0a6-9f28be032a82" returned: 0 in 0.632s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-be691029-a42b-4115-a0a6-9f28be032a82" released by "_delete_snapshot" :: held 2.899s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" released by "delete_snapshot" :: held 2.923s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Created reservations ['737e0eb7-84e7-48f2-b83f-fb351f74dd0a', 'c5659bbb-ba91-4f0e-a2a7-53ae44274739', '22bae77a-0526-4630-8928-2933b7530967', '4cfc17f0-ba2d-4b02-9967-f10865dfc49f'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Delete snapshot completed successfully. Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-69fe7599-d679-47df-9d4f-ca3640e3fcb7 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-be691029-a42b-4115-a0a6-9f28be032a82-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-4fe0ff5c-65ad-4a6a-b989-d8c389924c49-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-4fe0ff5c-65ad-4a6a-b989-d8c389924c49-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "cinder-quobyte-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" acquired by "delete_volume" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de212b2-406f-4d6c-8da4-da2d35536ace]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:10 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 Jul 07 17:47:10 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:11 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" returned: 0 in 0.745s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:11 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49 Jul 07 17:47:11 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:11 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" returned: 0 in 0.620s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-quobyte-4fe0ff5c-65ad-4a6a-b989-d8c389924c49" released by "delete_volume" :: held 1.421s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Created reservations ['6cbc985f-9386-495b-9b52-9ec79f095333', 'd31c04aa-bec1-405c-b795-d4de385e0dc8', 'd2284bdb-0727-49b4-a0cc-1b6efed6f7c6', 'a288c22b-74f5-45e4-bd32-612a2e1b6cc5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:11 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:47:11 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:12 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.655s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:12 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:12 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Deleted volume successfully. Jul 07 17:47:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-79780434-3661-4e2a-af36-9a2bf82b9304 tempest-ProjectMemberTests-1518515255 None] Lock "cinder-4fe0ff5c-65ad-4a6a-b989-d8c389924c49-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (acb7a329-b455-4aea-9580-7dc5a7094375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9695a-c0c1-44c6-ae5f-77c064bd0073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9695a-c0c1-44c6-ae5f-77c064bd0073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700473232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:16Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1655be6c-b959-48dd-919c-8a8000fc9e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1655be6c-b959-48dd-919c-8a8000fc9e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25645d2-f429-4bc5-a2b0-76c5bc8488d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25645d2-f429-4bc5-a2b0-76c5bc8488d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982', 'volume_name': 'volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9af056-b595-4cf6-88c7-b928af34ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9af056-b595-4cf6-88c7-b928af34ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96e740d-eeec-4b79-a97e-225ba64dbb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:16 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Volume b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982', 'volume_size': 1} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700473232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:16Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Creating volume b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:47:16 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:47:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:16 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 1073741824 Jul 07 17:47:16 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:17 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 1073741824" returned: 0 in 0.853s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:17 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 Jul 07 17:47:17 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:17 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" returned: 0 in 0.633s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96e740d-eeec-4b79-a97e-225ba64dbb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd0ad12-b807-4c4a-abb9-7a0eaa5447c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:17 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Volume volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 (b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982): created successfully Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd0ad12-b807-4c4a-abb9-7a0eaa5447c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:17 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (acb7a329-b455-4aea-9580-7dc5a7094375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:17 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ab6d841a-ca06-4de4-8c4d-9067e43018a7 tempest-ProjectReaderTests-921762252 None] Created volume successfully. Jul 07 17:47:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Creating offline snapshot e358349d-fdaf-4b98-8d30-1558621833d3 of volume b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:47:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[7282e57f-4e17-4c7f-9ffb-42bd35bd0bee]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:18 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 Jul 07 17:47:18 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:19 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:19 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 1G Jul 07 17:47:19 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:20 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 1G" returned: 0 in 0.792s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:20 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 Jul 07 17:47:20 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:20 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3" returned: 0 in 0.719s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:20 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 is being set with open permissions: ugo+rw Jul 07 17:47:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:20 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 Jul 07 17:47:20 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:21 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3" returned: 0 in 0.626s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:21 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info Jul 07 17:47:21 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:22 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info" returned: 0 in 0.622s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:22 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info is being set with open permissions: ugo+rw Jul 07 17:47:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:22 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info Jul 07 17:47:22 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:22 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.info" returned: 0 in 0.629s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:22 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-865dd190-97cc-4356-9e5a-8ed563109829 tempest-ProjectReaderTests-921762252 None] Create snapshot completed successfully Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-e358349d-fdaf-4b98-8d30-1558621833d3-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Lock "cinder-e358349d-fdaf-4b98-8d30-1558621833d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-e358349d-fdaf-4b98-8d30-1558621833d3" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-e358349d-fdaf-4b98-8d30-1558621833d3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Deleting offline snapshot e358349d-fdaf-4b98-8d30-1558621833d3 of volume b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] snapshot_file for this snap is: volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e80cd6-4a19-4cf2-b18c-131a6403a94f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:23 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 Jul 07 17:47:23 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:24 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3" returned: 0 in 0.809s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:24 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:47:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3632e75-e736-445a-9d96-650a9e4f1d13]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:24 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 Jul 07 17:47:24 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:25 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" returned: 0 in 0.789s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:25 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 Jul 07 17:47:25 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:26 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3" returned: 0 in 0.729s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:26 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3 Jul 07 17:47:26 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:26 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982.e358349d-fdaf-4b98-8d30-1558621833d3" returned: 0 in 0.647s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-e358349d-fdaf-4b98-8d30-1558621833d3" released by "_delete_snapshot" :: held 3.071s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" released by "delete_snapshot" :: held 3.095s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:26 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Created reservations ['5431203b-4467-4eac-bbf6-26e1077c4a7e', '08093aa1-9a44-4aeb-8367-a2c283dd2913', '0ddd7ac4-c27e-4cd4-a824-c1c73cb75a34', '9e149961-10d6-41b1-9240-ede5b58f255d'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:27 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Delete snapshot completed successfully. Jul 07 17:47:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-7610d245-3a13-4cfd-a8e0-c1e7c8db8419 tempest-ProjectReaderTests-921762252 None] Lock "cinder-e358349d-fdaf-4b98-8d30-1558621833d3-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Lock "cinder-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa650d1-b6cd-40e0-9885-0020689dae0c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:28 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 Jul 07 17:47:28 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:28 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" returned: 0 in 0.794s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:28 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982 Jul 07 17:47:28 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:29 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" returned: 0 in 0.664s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982" released by "delete_volume" :: held 1.522s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Created reservations ['09fc3e07-94c0-40e0-8aa4-4ea4592022c8', '03b5568c-96d6-46a5-b384-587a704a0a38', 'c6f317be-e106-4e2e-9887-37da2b0aec07', '04891f51-45e9-45c1-838f-2ae0958a8414'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:29 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:29 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:47:29 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:30 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.726s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:30 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Deleted volume successfully. Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f44af030-a7cf-4c66-af42-b56438114895 tempest-ProjectReaderTests-921762252 None] Lock "cinder-b7a0baa6-aea9-4fc0-a927-cc2c0ebc7982-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (7a850936-e219-4e10-b7dc-996984169dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed1fb5e-feff-4d55-8b9f-2b040afd5179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed1fb5e-feff-4d55-8b9f-2b040afd5179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470370325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:31Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af34037-d65c-42f6-bfb7-6f99a429f720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af34037-d65c-42f6-bfb7-6f99a429f720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca2049-a17f-4e65-9efb-a9e5f0b0af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca2049-a17f-4e65-9efb-a9e5f0b0af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5', 'volume_name': 'volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbba25c3-14f9-4b11-bf5b-fc26328c5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbba25c3-14f9-4b11-bf5b-fc26328c5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a715cb79-d81a-4af0-beb8-1f8a43257ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:30 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Volume bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5', 'volume_size': 1} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470370325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:31Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Creating volume bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:47:30 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:47:30 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:30 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 1073741824 Jul 07 17:47:30 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:31 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 1073741824" returned: 0 in 0.786s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:31 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:31 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 Jul 07 17:47:31 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:32 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" returned: 0 in 0.614s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a715cb79-d81a-4af0-beb8-1f8a43257ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f45e44d-1242-4bf5-a7f2-7245951bbea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:32 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Volume volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 (bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5): created successfully Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f45e44d-1242-4bf5-a7f2-7245951bbea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (7a850936-e219-4e10-b7dc-996984169dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:32 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-298456b7-8580-41b9-aee5-b8e0a778ac22 tempest-ProjectReaderTests-921762252 None] Created volume successfully. Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:32 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:47:32 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Creating offline snapshot ceb2fe82-3580-46b4-877e-1c2064a17408 of volume bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25dbb1f-a89d-4dc6-8ced-1c6061d9bd6e]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:33 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 Jul 07 17:47:33 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:33 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.723s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:47:33 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" returned: 0 in 0.742s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:33 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 1G Jul 07 17:47:33 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:34 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 1G" returned: 0 in 0.803s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:34 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:34 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 Jul 07 17:47:34 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:35 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408" returned: 0 in 0.657s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:35 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 is being set with open permissions: ugo+rw Jul 07 17:47:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:35 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 Jul 07 17:47:35 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:35 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408" returned: 0 in 0.601s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:35 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:35 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info Jul 07 17:47:35 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:36 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info" returned: 0 in 0.618s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:36 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info is being set with open permissions: ugo+rw Jul 07 17:47:36 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:36 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info Jul 07 17:47:36 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:37 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.info" returned: 0 in 0.622s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:37 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.117s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:37 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-21191637-9e01-42ed-b05e-36199d3475a6 tempest-ProjectReaderTests-921762252 None] Create snapshot completed successfully Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-ceb2fe82-3580-46b4-877e-1c2064a17408-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Lock "cinder-ceb2fe82-3580-46b4-877e-1c2064a17408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-ceb2fe82-3580-46b4-877e-1c2064a17408" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-ceb2fe82-3580-46b4-877e-1c2064a17408" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Deleting offline snapshot ceb2fe82-3580-46b4-877e-1c2064a17408 of volume bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] snapshot_file for this snap is: volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f394de6-edd3-4e48-ae2c-4d302bab85af]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:38 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 Jul 07 17:47:38 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:38 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408" returned: 0 in 0.711s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c2bc37-9ce8-4ccf-befa-79f5e081d326]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:38 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:39 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 Jul 07 17:47:39 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:39 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" returned: 0 in 0.712s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:39 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:39 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 Jul 07 17:47:39 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:40 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408" returned: 0 in 0.693s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:40 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408 Jul 07 17:47:40 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:40 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:40 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5.ceb2fe82-3580-46b4-877e-1c2064a17408" returned: 0 in 0.605s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-ceb2fe82-3580-46b4-877e-1c2064a17408" released by "_delete_snapshot" :: held 2.812s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" released by "delete_snapshot" :: held 2.833s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Created reservations ['33e43536-6748-472b-8527-d5c33919ca50', '3c6f19e8-c1e0-462a-9c39-8386882d08fc', '24b25424-17f9-4fe6-9668-f82df11529e8', 'a668ba17-76dd-4985-bafc-bf7564077d4b'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:41 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Delete snapshot completed successfully. Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-47ba9c7f-e2e5-49dc-bf9a-081cf29d9339 tempest-ProjectReaderTests-921762252 None] Lock "cinder-ceb2fe82-3580-46b4-877e-1c2064a17408-delete_snapshot" released by "delete_snapshot" :: held 2.957s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Lock "cinder-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" acquired by "delete_volume" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4923a-234f-4714-bc88-c6e470120bce]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:41 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:41 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 Jul 07 17:47:41 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:42 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" returned: 0 in 0.752s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:42 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5 Jul 07 17:47:42 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:42 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" returned: 0 in 0.633s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5" released by "delete_volume" :: held 1.440s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Created reservations ['a05d730f-6ee7-4bb2-a930-12906fd7f17c', '38a1409c-cb22-40e9-9cc2-eb14703aea99', '1559f0ea-5124-4977-b54a-403dc68c4e63', 'ca43889b-37fb-49d1-bbe5-0bd6a130985c'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:42 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:42 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:47:42 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:43 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.621s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:43 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Deleted volume successfully. Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-10d67da6-2051-4eb9-b4da-d15c530b2d52 tempest-ProjectReaderTests-921762252 None] Lock "cinder-bd8e1c4b-b1de-4bbc-ba2f-2a5c54ac59f5-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (5949b4d2-b31b-453b-b38a-499925c50a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c99b67-71a6-4ebc-8096-f73049273c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c99b67-71a6-4ebc-8096-f73049273c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629915217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36c9ad2-92d2-4cb2-acec-3d35639eb3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:44Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ebc831-52af-40e3-b1c4-496d43cb473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:43 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ebc831-52af-40e3-b1c4-496d43cb473f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8f5a99-0c98-4a2e-b5e0-3d1d13537198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8f5a99-0c98-4a2e-b5e0-3d1d13537198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36c9ad2-92d2-4cb2-acec-3d35639eb3b9', 'volume_name': 'volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9482d72f-0f52-4a35-9bc5-3377e153a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9482d72f-0f52-4a35-9bc5-3377e153a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9724f6-a4ee-4b02-9201-63da64a50002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:44 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Volume a36c9ad2-92d2-4cb2-acec-3d35639eb3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9', 'volume_size': 1} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629915217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36c9ad2-92d2-4cb2-acec-3d35639eb3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:44Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Creating volume a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:47:44 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:44 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 1073741824 Jul 07 17:47:44 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:44 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 1073741824" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:44 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:44 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 Jul 07 17:47:44 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:45 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" returned: 0 in 0.625s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9724f6-a4ee-4b02-9201-63da64a50002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1459f690-2884-4f42-9264-02fe94fda259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:45 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Volume volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 (a36c9ad2-92d2-4cb2-acec-3d35639eb3b9): created successfully Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1459f690-2884-4f42-9264-02fe94fda259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:45 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (5949b4d2-b31b-453b-b38a-499925c50a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:45 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-86b20c78-1085-40f6-8db1-04e33d336068 tempest-ProjectReaderTests-921762252 None] Created volume successfully. Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Creating offline snapshot 1d60e3a0-d451-4f12-a462-62c8882b5c2f of volume a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a466a7-e816-4bb9-8beb-63ce3863f826]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:46 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 Jul 07 17:47:46 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:46 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" returned: 0 in 0.725s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:46 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:46 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f 1G Jul 07 17:47:46 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:47 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f 1G" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:47 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:47 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f Jul 07 17:47:47 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:48 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f" returned: 0 in 0.649s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:48 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f is being set with open permissions: ugo+rw Jul 07 17:47:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:48 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f Jul 07 17:47:48 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:48 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:48 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f" returned: 0 in 0.598s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:49 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info Jul 07 17:47:49 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:49 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info" returned: 0 in 0.606s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:49 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info is being set with open permissions: ugo+rw Jul 07 17:47:49 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:49 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info Jul 07 17:47:49 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:50 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.info" returned: 0 in 0.642s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:50 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.089s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:50 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-85f89408-ee91-4aaf-a721-039f44dfb3ea tempest-ProjectReaderTests-921762252 None] Create snapshot completed successfully Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-1d60e3a0-d451-4f12-a462-62c8882b5c2f-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Lock "cinder-1d60e3a0-d451-4f12-a462-62c8882b5c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-1d60e3a0-d451-4f12-a462-62c8882b5c2f" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-1d60e3a0-d451-4f12-a462-62c8882b5c2f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Deleting offline snapshot 1d60e3a0-d451-4f12-a462-62c8882b5c2f of volume a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] snapshot_file for this snap is: volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be9563-97e3-4beb-8795-656078526f47]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:51 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:51 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f Jul 07 17:47:51 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:52 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f" returned: 0 in 0.730s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:52 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:47:52 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[818de116-4f4e-4d94-8dc3-9a6ba5b2d662]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:52 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 Jul 07 17:47:52 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:52 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" returned: 0 in 0.726s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:52 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:53 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f Jul 07 17:47:53 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:53 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f" returned: 0 in 0.699s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:53 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:53 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f Jul 07 17:47:53 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:54 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9.1d60e3a0-d451-4f12-a462-62c8882b5c2f" returned: 0 in 0.618s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-1d60e3a0-d451-4f12-a462-62c8882b5c2f" released by "_delete_snapshot" :: held 2.855s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" released by "delete_snapshot" :: held 2.878s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=63,cinder:INSERT=19,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=53,cinder:DELETE=10,cinder:INSERT=22,cinder:UPDATE=77 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Created reservations ['9839413a-33e6-468c-ad80-142d38280745', '4d22ac38-ac3e-412a-bf8c-45018d5ab462', 'b361421c-93d1-48a0-a0c3-25057ee0f979', '65a8981c-0ba9-4d20-8a55-a32bcbc8e147'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:54 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Delete snapshot completed successfully. Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-beb652af-e837-43f9-a890-e4d3504d2af9 tempest-ProjectReaderTests-921762252 None] Lock "cinder-1d60e3a0-d451-4f12-a462-62c8882b5c2f-delete_snapshot" released by "delete_snapshot" :: held 3.014s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Lock "cinder-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b925557-94b8-4472-b624-7994a5faadec]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:54 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:54 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 Jul 07 17:47:54 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:55 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" returned: 0 in 0.727s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:55 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:55 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9 Jul 07 17:47:55 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:56 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" returned: 0 in 0.642s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9" released by "delete_volume" :: held 1.426s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Created reservations ['5c60e80c-e9a1-42b7-882e-14417778c5fb', '5ed01305-4913-4d20-846b-a549f01c53cb', 'd0a1e47b-9339-4c60-b346-952a00e2e90b', '7d02679a-df48-4bab-8fed-c710430904d5'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:56 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:47:56 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:56 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.660s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:56 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Deleted volume successfully. Jul 07 17:47:56 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-305fae1b-5e66-4342-9f38-88afbb3d8b32 tempest-ProjectReaderTests-921762252 None] Lock "cinder-a36c9ad2-92d2-4cb2-acec-3d35639eb3b9-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (e51d8173-967e-4db0-9b90-d12655779ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28581f10-5b84-48e3-927b-abc3d1a8debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28581f10-5b84-48e3-927b-abc3d1a8debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199110713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7b0fae-7ccf-4816-bf32-f4e19b58f126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:57Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f962d57-daa0-4b0a-bcd0-bafffd187c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f962d57-daa0-4b0a-bcd0-bafffd187c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6b6027-c4a7-4373-b14e-dca780bcaf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6b6027-c4a7-4373-b14e-dca780bcaf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7b0fae-7ccf-4816-bf32-f4e19b58f126', 'volume_name': 'volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c681d85-aad3-4147-86fc-c8edf191df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c681d85-aad3-4147-86fc-c8edf191df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d788f-dd45-44d2-9c35-e134712b66db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:57 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Volume bd7b0fae-7ccf-4816-bf32-f4e19b58f126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126', 'volume_size': 1} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199110713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7b0fae-7ccf-4816-bf32-f4e19b58f126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:47:57Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Creating volume bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:47:57 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:47:57 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:57 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 1073741824 Jul 07 17:47:57 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:58 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 1073741824" returned: 0 in 0.782s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:58 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 Jul 07 17:47:58 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:58 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" returned: 0 in 0.613s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d788f-dd45-44d2-9c35-e134712b66db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0012d2e-06d6-46fc-aabd-e430ebbd4ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:47:58 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Volume volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 (bd7b0fae-7ccf-4816-bf32-f4e19b58f126): created successfully Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0012d2e-06d6-46fc-aabd-e430ebbd4ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:47:58 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (e51d8173-967e-4db0-9b90-d12655779ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:47:58 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-ff7b2a57-8e46-4e6d-aa09-e287b3517c28 tempest-ProjectReaderTests-921762252 None] Created volume successfully. Jul 07 17:47:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:59 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Creating offline snapshot 3d268b99-00ac-473d-8a48-95d4e6c433e8 of volume bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:47:59 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3befcb-d7f2-4258-be67-d53b9841fde7]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:47:59 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:59 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 Jul 07 17:47:59 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:00 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" returned: 0 in 0.764s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:00 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:00 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 1G Jul 07 17:48:00 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:01 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 1G" returned: 0 in 0.776s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:01 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 Jul 07 17:48:01 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:01 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8" returned: 0 in 0.641s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:01 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 is being set with open permissions: ugo+rw Jul 07 17:48:01 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:01 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 Jul 07 17:48:01 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:02 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8" returned: 0 in 0.605s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:02 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info Jul 07 17:48:02 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:02 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info" returned: 0 in 0.620s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:02 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info is being set with open permissions: ugo+rw Jul 07 17:48:02 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:02 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info Jul 07 17:48:02 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:03 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.info" returned: 0 in 0.654s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:03 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:03 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-b9d7655f-3634-4559-86e6-f4e793b9a35d tempest-ProjectReaderTests-921762252 None] Create snapshot completed successfully Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-3d268b99-00ac-473d-8a48-95d4e6c433e8-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Lock "cinder-3d268b99-00ac-473d-8a48-95d4e6c433e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-3d268b99-00ac-473d-8a48-95d4e6c433e8" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-3d268b99-00ac-473d-8a48-95d4e6c433e8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Deleting offline snapshot 3d268b99-00ac-473d-8a48-95d4e6c433e8 of volume bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] snapshot_file for this snap is: volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c457e46-15c8-4e92-814d-062695d4a20d]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:04 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 Jul 07 17:48:04 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:05 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:48:05 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b660c078-9e3b-42af-bc2c-0f32283f1618]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:05 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 Jul 07 17:48:05 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:06 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" returned: 0 in 0.720s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:06 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 Jul 07 17:48:06 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:06 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8" returned: 0 in 0.724s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:06 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8 Jul 07 17:48:06 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:07 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126.3d268b99-00ac-473d-8a48-95d4e6c433e8" returned: 0 in 0.628s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-3d268b99-00ac-473d-8a48-95d4e6c433e8" released by "_delete_snapshot" :: held 2.877s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" released by "delete_snapshot" :: held 2.899s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Created reservations ['127f4593-01ea-4f94-bf18-4191b0d8318e', '059e3541-0dcc-4a82-9dbd-1a8e3c914bfd', '396e20c7-8e1f-4972-b1c5-886e97ee8bf5', '3f7eea9e-30ef-45db-9253-ac3bd6f3f445'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:48:07 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Delete snapshot completed successfully. Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-27d37999-7ef5-40b2-984d-533a320c13ec tempest-ProjectReaderTests-921762252 None] Lock "cinder-3d268b99-00ac-473d-8a48-95d4e6c433e8-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-bd7b0fae-7ccf-4816-bf32-f4e19b58f126-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Lock "cinder-bd7b0fae-7ccf-4816-bf32-f4e19b58f126-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a09aad-e2ac-4280-bf41-6313b2c50ea4]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:08 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 Jul 07 17:48:08 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:08 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" returned: 0 in 0.699s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:08 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126 Jul 07 17:48:08 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:09 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" returned: 0 in 0.647s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-bd7b0fae-7ccf-4816-bf32-f4e19b58f126" released by "delete_volume" :: held 1.398s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Created reservations ['c643da72-7799-4852-9859-c0c10e6e2521', '55cd8beb-6a42-410d-8796-60a08ef35ccd', '532d1b7b-48dd-4f38-88ba-5d04387c55ae', 'e65904ae-09f0-4418-8de5-534a77ec967e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:09 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:48:09 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:10 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.634s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:48:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Deleted volume successfully. Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-f609e1ab-bba4-4bd0-9228-8dad113d9f29 tempest-ProjectReaderTests-921762252 None] Lock "cinder-bd7b0fae-7ccf-4816-bf32-f4e19b58f126-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (312a6f66-404e-4f5d-8d42-6ff5bdfaf7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1699d7bb-a9b8-4c3a-a340-1bde4a2b996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1699d7bb-a9b8-4c3a-a340-1bde4a2b996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793319646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec786c1-2a61-438e-baab-d2812b4b52e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:48:10Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f95d09-cccd-43a5-90f1-3f62407466c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f95d09-cccd-43a5-90f1-3f62407466c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e60d2c-d813-4253-a2c5-b8be01d237a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e60d2c-d813-4253-a2c5-b8be01d237a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec786c1-2a61-438e-baab-d2812b4b52e2', 'volume_name': 'volume-eec786c1-2a61-438e-baab-d2812b4b52e2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a8c23a-bc7f-413d-9426-1767f8e9abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a8c23a-bc7f-413d-9426-1767f8e9abfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f44394-ce40-4005-b1e6-6c34fe2c1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:10 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Volume eec786c1-2a61-438e-baab-d2812b4b52e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec786c1-2a61-438e-baab-d2812b4b52e2', 'volume_size': 1} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793319646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec786c1-2a61-438e-baab-d2812b4b52e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e9b067347e41c282eb0173506f5175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:48:10Z,use_quota=True,user_id='bb3e7d40f6d9436aab508c59e138c028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Creating volume eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:48:10 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:48:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:10 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 1073741824 Jul 07 17:48:10 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:11 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 1073741824" returned: 0 in 0.828s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:11 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:11 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 Jul 07 17:48:11 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:12 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2" returned: 0 in 0.623s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f44394-ce40-4005-b1e6-6c34fe2c1773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec786c1-2a61-438e-baab-d2812b4b52e2', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b95e9d-943b-42bd-9a83-88cd4e8849d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Volume volume-eec786c1-2a61-438e-baab-d2812b4b52e2 (eec786c1-2a61-438e-baab-d2812b4b52e2): created successfully Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b95e9d-943b-42bd-9a83-88cd4e8849d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Flow 'volume_create_manager' (312a6f66-404e-4f5d-8d42-6ff5bdfaf7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:48:12 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-e2c40e18-b333-4df5-b4ca-a4d3748b4950 tempest-ProjectReaderTests-921762252 None] Created volume successfully. Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Creating offline snapshot 69df65f7-2eb2-4ff0-8585-30b09657caf5 of volume eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[57801146-6788-40b2-943e-cb47fa926370]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:12 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 Jul 07 17:48:12 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:13 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2" returned: 0 in 0.817s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:13 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 1G Jul 07 17:48:13 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:14 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 1G" returned: 0 in 0.794s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec786c1-2a61-438e-baab-d2812b4b52e2 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:14 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec786c1-2a61-438e-baab-d2812b4b52e2 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 Jul 07 17:48:14 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:15 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec786c1-2a61-438e-baab-d2812b4b52e2 -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5" returned: 0 in 0.640s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:15 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 is being set with open permissions: ugo+rw Jul 07 17:48:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:15 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 Jul 07 17:48:15 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:15 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5" returned: 0 in 0.610s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:15 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:15 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info Jul 07 17:48:15 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:16 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info" returned: 0 in 0.612s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:16 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info is being set with open permissions: ugo+rw Jul 07 17:48:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:16 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info Jul 07 17:48:16 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:16 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.info" returned: 0 in 0.610s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:16 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:16 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5748a2e2-2535-46de-a338-c352e10386dc tempest-ProjectReaderTests-921762252 None] Create snapshot completed successfully Jul 07 17:48:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-69df65f7-2eb2-4ff0-8585-30b09657caf5-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Lock "cinder-69df65f7-2eb2-4ff0-8585-30b09657caf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-eec786c1-2a61-438e-baab-d2812b4b52e2" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-eec786c1-2a61-438e-baab-d2812b4b52e2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:17 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-69df65f7-2eb2-4ff0-8585-30b09657caf5" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-69df65f7-2eb2-4ff0-8585-30b09657caf5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Deleting offline snapshot 69df65f7-2eb2-4ff0-8585-30b09657caf5 of volume eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] snapshot_file for this snap is: volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63761d8-b150-40a2-bdda-36784cffffb1]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:18 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 Jul 07 17:48:18 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:18 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5" returned: 0 in 0.732s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eec786c1-2a61-438e-baab-d2812b4b52e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d0cc3-e8b6-439d-b7d5-45cc0363f917]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:18 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 Jul 07 17:48:18 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:19 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2" returned: 0 in 0.758s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:19 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 Jul 07 17:48:19 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:20 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5" returned: 0 in 0.742s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:20 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5 Jul 07 17:48:20 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:20 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:20 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2.69df65f7-2eb2-4ff0-8585-30b09657caf5" returned: 0 in 0.675s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-69df65f7-2eb2-4ff0-8585-30b09657caf5" released by "_delete_snapshot" :: held 2.999s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-eec786c1-2a61-438e-baab-d2812b4b52e2" released by "delete_snapshot" :: held 3.018s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:21 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Created reservations ['62fb544a-53a2-4861-aede-a5ecefccc1d1', 'd9b92be8-05c8-401f-8f6b-d99780104ce5', '4fb3b75a-cbd1-4378-b423-009741186fee', 'a36a533a-364b-49c3-a748-26872ae040a1'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:48:21 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Delete snapshot completed successfully. Jul 07 17:48:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-417e7a35-4bb2-43e5-8005-3d5d4aac1baa tempest-ProjectReaderTests-921762252 None] Lock "cinder-69df65f7-2eb2-4ff0-8585-30b09657caf5-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-eec786c1-2a61-438e-baab-d2812b4b52e2-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Lock "cinder-eec786c1-2a61-438e-baab-d2812b4b52e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Acquiring lock "cinder-quobyte-eec786c1-2a61-438e-baab-d2812b4b52e2" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:48:22 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-eec786c1-2a61-438e-baab-d2812b4b52e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:48:22 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[90803863-9b9f-4d79-8068-b00e23f03ebd]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:22 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 Jul 07 17:48:22 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:23 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2" returned: 0 in 0.736s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:23 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2 Jul 07 17:48:23 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:23 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-eec786c1-2a61-438e-baab-d2812b4b52e2" returned: 0 in 0.616s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Lock "cinder-quobyte-eec786c1-2a61-438e-baab-d2812b4b52e2" released by "delete_volume" :: held 1.406s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Created reservations ['6dc1144c-f171-4aa5-a9b4-14edcda01307', 'f6944e19-9285-412c-b19d-d67e1eb1365d', '38e1f5aa-3171-4c92-8fee-c73c38d89cc4', 'a9ac1cdf-66a4-4d80-b7a8-0aea1978a27a'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:23 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:48:23 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:24 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.652s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:24 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:48:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Deleted volume successfully. Jul 07 17:48:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5c3a1d41-5c92-4cee-928c-120f04072540 tempest-ProjectReaderTests-921762252 None] Lock "cinder-eec786c1-2a61-438e-baab-d2812b4b52e2-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:32 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:48:32 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:33 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.646s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:48:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:48:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:48:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:48:33 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=36,cinder:INSERT=14,cinder:UPDATE=51,cinder:DELETE=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:48:34 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Flow 'volume_create_manager' (47f14bdd-d987-40cb-b867-19f14868a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60485f39-3a0f-4b5c-bb24-da8a44e58095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60485f39-3a0f-4b5c-bb24-da8a44e58095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1237811552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5115e5b3-113d-418f-8b79-cfd8bfc4c8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588d3f84efed47179b04b3eecd9a1a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:04Z,use_quota=True,user_id='4ac6a6d2da4e474795818f1469a73cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dd3c83-d9ff-475b-bfd2-5d31759f17d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dd3c83-d9ff-475b-bfd2-5d31759f17d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0025c39-0712-47ce-bb09-23d4dbabf1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0025c39-0712-47ce-bb09-23d4dbabf1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5115e5b3-113d-418f-8b79-cfd8bfc4c8bf', 'volume_name': 'volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b07877-dd00-4f73-868d-6ba6384daaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b07877-dd00-4f73-868d-6ba6384daaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db26863-4037-4a60-8ed1-48352c036185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Volume 5115e5b3-113d-418f-8b79-cfd8bfc4c8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf', 'volume_size': 1} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1237811552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5115e5b3-113d-418f-8b79-cfd8bfc4c8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588d3f84efed47179b04b3eecd9a1a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:04Z,use_quota=True,user_id='4ac6a6d2da4e474795818f1469a73cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)}" {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Creating volume 5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:49:04 devstack cinder-volume[87251]: INFO cinder.volume.drivers.remotefs [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] casted to osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 Jul 07 17:49:04 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf 1073741824 {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:04 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf 1073741824 Jul 07 17:49:04 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:05 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf 1073741824" returned: 0 in 0.779s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:05 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:05 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:05 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.611s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'} {{(pid=87251) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db26863-4037-4a60-8ed1-48352c036185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf', 'volume_size': 1}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03c81e2-0c53-4bd7-b334-fbc5cbc18c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:05 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Volume volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf (5115e5b3-113d-418f-8b79-cfd8bfc4c8bf): created successfully Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03c81e2-0c53-4bd7-b334-fbc5cbc18c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:05 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Flow 'volume_create_manager' (47f14bdd-d987-40cb-b867-19f14868a56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:05 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-d96a6e39-0a7c-4455-8fb4-ac29daba7850 tempest-SnapshotDependencyTests-484255457 None] Created volume successfully. Jul 07 17:49:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:06 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Creating offline snapshot db2131b5-eb7c-4e9f-988b-e3d4659642ce of volume 5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:49:06 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b59c25-9600-4e78-b8d8-39644654c184]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:06 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:06 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:06 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:07 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.721s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce 1G {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:07 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce 1G Jul 07 17:49:07 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:07 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce 1G" returned: 0 in 0.767s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:07 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:07 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce Jul 07 17:49:07 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:08 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf -F qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce" returned: 0 in 0.690s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:08 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce is being set with open permissions: ugo+rw Jul 07 17:49:08 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:08 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce Jul 07 17:49:08 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:09 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce" returned: 0 in 0.627s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:09 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info Jul 07 17:49:09 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:09 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info" returned: 0 in 0.616s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:09 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info is being set with open permissions: ugo+rw Jul 07 17:49:09 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:09 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info Jul 07 17:49:09 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:10 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.info" returned: 0 in 0.613s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:10 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.134s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:10 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8e1c9769-7d6c-4611-9626-8fa4a3f22b3a tempest-SnapshotDependencyTests-484255457 None] Create snapshot completed successfully Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.flows.manager.create_volume [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87251) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Flow 'volume_create_manager' (5dddcb26-9be1-4684-8d58-827e631df034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945de007-06ec-4d36-a1b0-b65d9e505ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945de007-06ec-4d36-a1b0-b65d9e505ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b7e995-8984-42e8-89d9-1087e3ae0eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588d3f84efed47179b04b3eecd9a1a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db2131b5-eb7c-4e9f-988b-e3d4659642ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:12Z,use_quota=True,user_id='4ac6a6d2da4e474795818f1469a73cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23a80ee-35b7-4f12-b907-6e90c270e782),volume_type_id=f23a80ee-35b7-4f12-b907-6e90c270e782)' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e286ba7f-99b7-407e-9ab6-c7be4c7085d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e286ba7f-99b7-407e-9ab6-c7be4c7085d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01ed9b2-de0d-4471-861c-def3d2dc5bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01ed9b2-de0d-4471-861c-def3d2dc5bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01b7e995-8984-42e8-89d9-1087e3ae0eba', 'volume_name': 'volume-01b7e995-8984-42e8-89d9-1087e3ae0eba', 'volume_size': 1, 'snapshot_id': 'db2131b5-eb7c-4e9f-988b-e3d4659642ce'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888612d8-5d0d-4538-ba07-f34a8eeb96c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888612d8-5d0d-4538-ba07-f34a8eeb96c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7706126-5ede-446e-8c01-1fd5036851c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:12 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Volume 01b7e995-8984-42e8-89d9-1087e3ae0eba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01b7e995-8984-42e8-89d9-1087e3ae0eba', 'volume_size': 1, 'snapshot_id': 'db2131b5-eb7c-4e9f-988b-e3d4659642ce'} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-quobyte-db2131b5-eb7c-4e9f-988b-e3d4659642ce-01b7e995-8984-42e8-89d9-1087e3ae0eba" by "_create_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-db2131b5-eb7c-4e9f-988b-e3d4659642ce-01b7e995-8984-42e8-89d9-1087e3ae0eba" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Creating volume 01b7e995-8984-42e8-89d9-1087e3ae0eba from snapshot db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Selected osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070 as target Quobyte volume. {{(pid=87251) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-quobyte-01b7e995-8984-42e8-89d9-1087e3ae0eba" by "_copy_volume_from_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-01b7e995-8984-42e8-89d9-1087e3ae0eba" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] snapshot: db2131b5-eb7c-4e9f-988b-e3d4659642ce, volume: 01b7e995-8984-42e8-89d9-1087e3ae0eba, {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c970b0b-b2a6-41cc-9d16-480e30d14a9f]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:12 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:12 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce Jul 07 17:49:12 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:13 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce" returned: 0 in 0.812s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:49:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:49:13 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Creating direct copy from snapshot {{(pid=87251) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:49:13 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261d836-4142-4e8a-8534-93b7ce8e92d9]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:13 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:13 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:13 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:14 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.784s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:14 devstack cinder-volume[87251]: DEBUG cinder.utils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Path /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba not found in is_blk_device check {{(pid=87251) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:49:14 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:14 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba Jul 07 17:49:14 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:18 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba" returned: 0 in 4.263s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:18 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d49fa-5695-4eed-bddd-66452382bfe5]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:18 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:18 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:18 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:19 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.872s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.image.image_utils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Image conversion details: src /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba {{(pid=87251) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:49:19 devstack cinder-volume[87251]: INFO cinder.image.image_utils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Converted 1024.00 MB image at 240.13 MB/s Jul 07 17:49:19 devstack cinder-volume[87251]: WARNING cinder.volume.drivers.remotefs [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba is being set with open permissions: ugo+rw Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:19 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba Jul 07 17:49:19 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:19 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba" returned: 0 in 0.634s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-01b7e995-8984-42e8-89d9-1087e3ae0eba" released by "_copy_volume_from_snapshot" :: held 7.451s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-db2131b5-eb7c-4e9f-988b-e3d4659642ce-01b7e995-8984-42e8-89d9-1087e3ae0eba" released by "_create_volume_from_snapshot" :: held 7.480s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.500s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7706126-5ede-446e-8c01-1fd5036851c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b7e995-8984-42e8-89d9-1087e3ae0eba', 'volume_size': 1, 'snapshot_id': 'db2131b5-eb7c-4e9f-988b-e3d4659642ce'}' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e97f934-64d1-41ca-95f2-553ddd9ad5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:19 devstack cinder-volume[87251]: INFO cinder.volume.flows.manager.create_volume [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Volume volume-01b7e995-8984-42e8-89d9-1087e3ae0eba (01b7e995-8984-42e8-89d9-1087e3ae0eba): created successfully Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e97f934-64d1-41ca-95f2-553ddd9ad5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87251) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:19 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Flow 'volume_create_manager' (5dddcb26-9be1-4684-8d58-827e631df034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87251) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:19 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-1558763f-4e75-49bf-9d3d-c86e25029386 tempest-SnapshotDependencyTests-484255457 None] Created volume successfully. Jul 07 17:49:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-db2131b5-eb7c-4e9f-988b-e3d4659642ce-delete_snapshot" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-db2131b5-eb7c-4e9f-988b-e3d4659642ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-quobyte-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" by "delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:20 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-quobyte-db2131b5-eb7c-4e9f-988b-e3d4659642ce" by "_delete_snapshot" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-db2131b5-eb7c-4e9f-988b-e3d4659642ce" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Deleting offline snapshot db2131b5-eb7c-4e9f-988b-e3d4659642ce of volume 5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] snapshot_file for this snap is: volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed68449-1a33-43eb-9322-727c93546982]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:21 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce Jul 07 17:49:21 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:21 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce" returned: 0 in 0.754s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.remotefs [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87251) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f231180-73a4-46c1-a260-7c35a1f889ba]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:21 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:21 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:21 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:22 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.763s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:22 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:22 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce Jul 07 17:49:22 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:23 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce" returned: 0 in 0.739s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:23 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce Jul 07 17:49:23 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:23 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:23 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf.db2131b5-eb7c-4e9f-988b-e3d4659642ce" returned: 0 in 0.639s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-db2131b5-eb7c-4e9f-988b-e3d4659642ce" released by "_delete_snapshot" :: held 2.990s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" released by "delete_snapshot" :: held 3.011s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Created reservations ['5fd5eb5b-8870-4e14-b7c3-798d8ea53408', 'd99c7424-2afa-4d2b-9ddf-3dfcea0ba759', 'daeb0f59-7b36-4688-a02a-bccd27b1057d', '6ba1992b-a847-4738-892c-77373f9f196e'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:49:24 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Delete snapshot completed successfully. Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-c1f117c0-64ce-4d1e-9705-6145064e84f4 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-db2131b5-eb7c-4e9f-988b-e3d4659642ce-delete_snapshot" released by "delete_snapshot" :: held 3.152s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-quobyte-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d7765-05d3-4c62-b01a-e74dae57ebab]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:24 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:24 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:24 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:25 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.792s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:25 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf Jul 07 17:49:25 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:25 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" returned: 0 in 0.651s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf" released by "delete_volume" :: held 1.502s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Created reservations ['6a4a00d7-8103-4467-a042-0c62d826a873', 'f0bdbe88-2b15-4ff3-9117-447a1ce450f3', '340deb25-d9a3-46e9-a827-4776e19c79e2', 'cacc5c30-5d15-429a-b18c-b5e0d2bad649'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:25 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:25 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:49:25 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-01b7e995-8984-42e8-89d9-1087e3ae0eba-delete_volume" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-01b7e995-8984-42e8-89d9-1087e3ae0eba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "cinder-quobyte-01b7e995-8984-42e8-89d9-1087e3ae0eba" by "delete_volume" {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-01b7e995-8984-42e8-89d9-1087e3ae0eba" acquired by "delete_volume" :: waited 0.018s {{(pid=87251) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:26 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.692s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84a7a5-f57d-4664-95e8-3229d2684d5c]: (4, 'qcow2') {{(pid=88195) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:26 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Deleted volume successfully. Jul 07 17:49:26 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-5648f678-ce41-4219-9701-9d383f185bc5 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-5115e5b3-113d-418f-8b79-cfd8bfc4c8bf-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:26 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba Jul 07 17:49:26 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:27 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba" returned: 0 in 0.765s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:27 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba Jul 07 17:49:27 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:27 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:27 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f/volume-01b7e995-8984-42e8-89d9-1087e3ae0eba" returned: 0 in 0.599s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:27 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-quobyte-01b7e995-8984-42e8-89d9-1087e3ae0eba" released by "delete_volume" :: held 1.408s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:27 devstack cinder-volume[87251]: DEBUG cinder.quota [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Created reservations ['bc510af9-b43e-4ad4-a731-cbf883c4ee58', '1d5ac193-1342-42d4-8f5d-dbf82cad310b', 'f1cd3af6-c627-4e8d-b5b0-283ca7f261bd', '44b08df0-be8f-4a8d-b888-d26cf4302fba'] {{(pid=87251) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:28 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:49:28 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:28 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.672s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:49:28 devstack cinder-volume[87251]: INFO cinder.volume.manager [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Deleted volume successfully. Jul 07 17:49:28 devstack cinder-volume[87251]: DEBUG cinder.coordination [None req-8e5437e8-b6aa-4b08-9b6c-a5dfe7bc1062 tempest-SnapshotDependencyTests-484255457 None] Lock "cinder-01b7e995-8984-42e8-89d9-1087e3ae0eba-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87251) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070': None} {{(pid=87251) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG cinder.volume.drivers.quobyte [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-94bb6557-a919-4c29-a2b6-21d59480a070'] {{(pid=87251) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.lockutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87251) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:32 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:32 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f Jul 07 17:49:32 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:33 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:33 devstack cinder-volume[87251]: DEBUG oslo_concurrency.processutils [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d90def05935bcdc5070626ae5be9165f" returned: 0 in 0.697s {{(pid=87251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:33 devstack cinder-volume[87251]: DEBUG cinder.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Notifying Schedulers of capabilities ... {{(pid=87251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:49:33 devstack cinder-volume[87251]: DEBUG oslo_service.periodic_task [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] Running periodic task VolumeManager._thread_info {{(pid=87251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:49:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread count: 28 {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:49:33 devstack cinder-volume[87251]: DEBUG cinder.volume.manager [None req-c9379981-82a5-4817-ae25-7f2ca9f83e79 None None] thread info: [<_MainThread(MainThread, started 131700636409984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:49:38 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:49:38 devstack cinder-volume[87251]: DEBUG dbcounter [-] [87251] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}